00000001:02000400:3.0F:1789578686.510525:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789578698.221226:0:3493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789578700.182503:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 679 MB/s 00000001:01000000:2.0:1789578700.433618:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 609 MB/s 00000001:01000000:1.0F:1789578700.684323:0:3555:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3135 MB/s 00000020:02000000:1.0:1789578701.628860:0:3584:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gf14a6ef 00000400:02000000:3.0:1789578702.916469:0:3599:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.137@tcp [8/256/0/180] 00008000:02000000:0.0F:1789578707.180927:0:3749:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789578774.112806:0:5717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789578786.764042:0:6467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789578786.764049:0:6467:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789578786.764050:0:6467:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789578786.764199:0:6467:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000097a8d9cc 00000080:02000400:3.0:1789578786.764210:0:6467:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789578786.772952:0:6467:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789578786.772966:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789578786.774513:0:6467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008950dc0e) 00000020:00000080:2.0:1789578786.774552:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789578786.853135:0:6467:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789578786.853261:0:6467:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1789578786.890614:0:6467:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789578786.890864:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789578786.890873:0:6467:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789578786.890888:0:6467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f207ef 00000020:01000004:2.0:1789578786.890896:0:6467:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789578786.891143:0:6467:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789578786.891150:0:6467:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000097a8d9cc from MGS 00000020:01000004:2.0:1789578786.891155:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789578786.891167:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002df7f433) 00000020:00000080:2.0:1789578786.891179:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789578786.891251:0:6467:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000097a8d9cc from MGS, refs=2 00080000:01000000:2.0:1789578786.891256:0:6467:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789578786.891261:0:6467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f207fd 00000100:00100000:2.0:1789578786.891392:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789578786.891622:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789578786.891629:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789578786.893960:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789578786.893981:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789578786.895231:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789578786.895729:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789578786.895737:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789578786.898123:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789578786.898560:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789578786.900271:0:6467:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789578786.900288:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789578786.909473:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578786.909483:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578786.909485:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578786.909994:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578786.909998:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578786.909999:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578786.910772:0:6467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789578786.915913:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789578787.163410:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2802 MB/s 00000001:01000000:3.0:1789578787.413436:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2623 MB/s 00000001:01000000:2.0:1789578787.666322:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 547 MB/s 00000001:01000000:3.0:1789578787.915610:0:6467:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 543 MB/s 00080000:10000000:0.0:1789578787.925236:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1789578787.949927:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789578787.950779:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789578787.951399:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789578787.951417:0:6467:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789578787.951446:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789578787.951576:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789578787.951596:0:6467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789578787.954126:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789578787.954321:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789578787.954329:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789578787.962452:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789578787.962465:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789578787.967599:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789578787.967613:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789578787.968187:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789578787.968210:0:6467:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.137@tcp' 00000020:01000004:3.0:1789578787.968212:0:6467:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789578787.968265:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.137@tcp (typ=mgc) 00000020:00000080:3.0:1789578787.968284:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.137@tcp (000000004be55dd6) 00000020:00000080:3.0:1789578787.968300:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789578787.968469:0:6467:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000006844fc3@MGC192.168.203.137@tcp: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578787.968640:0:6467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.137@tcp-0 is initialized 00000040:01000000:3.0:1789578787.968647:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789578787.971767:0:6487:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789578787.971816:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.137@tcp (uuid 42b2619d-9ae6-4775-a880-4d874c1635bc) 00000020:00000080:0.0:1789578787.971838:0:6467:0:(genops.c:1384:class_connect()) connect: client 42b2619d-9ae6-4775-a880-4d874c1635bc, cookie 0xd90373d592f2080b 00000100:00080000:0.0:1789578787.971849:0:6467:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789578787.971860:0:6467:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import 0000000006844fc3 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578787.971901:0:6467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000043c5cee5 x1876509277028480/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789578787.971923:0:6467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS 00000020:01000004:0.0:1789578787.971943:0:6467:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789578787.971948:0:6467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789578787.971968:0:6467:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006ecfb1d1) 00000020:00000080:0.0:1789578787.971982:0:6467:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789578787.973111:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043c5cee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277028480:0@lo:250: 00000100:00100000:3.0:1789578787.973214:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789578787.980087:0:6486:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789578787.984946:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277028480 00000100:00100000:2.0:1789578787.984960:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277028480 00000100:00100000:2.0:1789578787.985016:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789578787.985023:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b08b2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3614:x1876509277028480:12345-0@lo:250: 00010000:00080000:2.0:1789578787.985050:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 42b2619d-9ae6-4775-a880-4d874c1635bc@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:2.0:1789578787.985090:0:6484:0:(genops.c:1384:class_connect()) connect: client 42b2619d-9ae6-4775-a880-4d874c1635bc, cookie 0xd90373d592f20819 00000100:00080000:2.0:1789578787.985202:0:6484:0:(import.c:65:import_set_state_nolock()) 0000000020aff637 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578787.985303:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b08b2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+5:3614:x1876509277028480:12345-0@lo:250: Request processed in 279us (12089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578787.985972:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789578787.985982:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.137@tcp: connect to target with instance 0 00000100:00080000:3.0:1789578787.985990:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789578787.985994:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789578787.985997:0:3614:0:(import.c:65:import_set_state_nolock()) 0000000006844fc3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789578787.986000:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789578787.986015:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789578787.986020:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043c5cee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277028480:0@lo:250: 00000100:00100000:2.0:1789578787.997827:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789578788.010734:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789578788.010924:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789578788.010930:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789578788.011771:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789578788.011777:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789578788.013848:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789578788.013860:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789578788.015962:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789578788.016158:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789578788.016165:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789578788.018918:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789578788.018937:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789578788.203634:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789578788.203870:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789578788.203877:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789578788.205396:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789578788.205408:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789578788.206099:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578788.206297:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789578788.206301:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789578788.206815:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789578788.206822:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789578788.207725:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789578788.207878:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789578788.207883:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789578788.208398:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789578788.208404:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789578788.214831:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789578788.215054:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789578788.215061:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789578788.216736:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789578788.216747:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789578788.249482:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578788.249848:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789578788.249856:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789578788.251100:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789578788.251245:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789578788.253863:0:6467:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789578788.253877:0:6467:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789578788.254856:0:6467:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789578788.254883:0:6467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789578788.254889:0:6467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789578788.254991:0:6467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789578788.255030:0:6467:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789578788.255035:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789578788.255036:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789578788.255037:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789578788.255038:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789578788.255039:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789578788.255041:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789578788.255042:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789578788.255043:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789578788.255044:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789578788.255045:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789578788.255046:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789578788.255052:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789578788.255054:0:6467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789578788.255056:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789578788.255056:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789578788.255057:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789578788.255058:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789578788.255059:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789578788.255059:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789578788.255060:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789578788.255061:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789578788.255062:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789578788.255062:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789578788.255063:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789578788.255064:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789578788.255100:0:6467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789578788.255256:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a431223 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028608:0@lo:253: 00000100:00100000:2.0:1789578788.255331:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.255515:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005d863b4 going to sleep for 11 seconds 00000100:00100000:1.0:1789578788.255639:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277028608 00000100:00100000:1.0:1789578788.255648:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277028608 00000100:00100000:1.0:1789578788.255735:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578788.255744:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a29694d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6467:x1876509277028608:12345-0@lo:253: 20000000:01000000:1.0:1789578788.255792:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789578788.255796:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789578788.256339:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789578788.256428:0:6485:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789578788.256734:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578788.257800:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789578788.258026:0:6485:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789578788.258030:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789578788.258036:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789578788.258039:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789578788.258051:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789578788.258329:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789578788.258689:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789578788.258703:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789578788.258722:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789578788.258737:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789578788.258750:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789578788.258804:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789578788.258811:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789578788.258822:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789578788.258827:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789578788.258836:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789578788.258840:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789578788.258852:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789578788.258865:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789578788.258891:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789578788.258896:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789578788.258902:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789578788.258986:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789578788.258996:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789578788.259011:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789578788.259027:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789578788.259044:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789578788.259056:0:6485:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789578788.259097:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789578788.259261:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789578788.259280:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789578788.259295:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789578788.259307:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789578788.259327:0:6485:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789578788.259714:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789578788.259725:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789578788.259743:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789578788.259763:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789578788.259846:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789578788.259867:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789578788.259876:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789578788.260498:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789578788.260706:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789578788.260726:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.137@tcp for mdt 20000000:01000000:1.0:1789578788.260727:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789578788.260742:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789578788.260747:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789578788.260760:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789578788.260765:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:1.0:1789578788.260774:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789578788.260781:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789578788.260791:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789578788.260804:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789578788.260827:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789578788.260830:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789578788.260834:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789578788.260891:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789578788.260893:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789578788.261432:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789578788.261591:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789578788.261613:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789578788.261628:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789578788.261640:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789578788.261642:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789578788.261966:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789578788.262263:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789578788.262284:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789578788.262298:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789578788.264046:0:6485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789578788.264053:0:6485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789578788.264063:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789578788.264068:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789578788.264088:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789578788.264096:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789578788.265628:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789578788.267340:0:6485:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789578788.277778:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789578788.277819:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789578788.277836:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789578788.277918:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789578788.277941:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277957:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277968:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277974:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277980:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277986:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.277991:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009175fcf already unused, calling callback (00000000151b4d03) 00010000:00010000:0.0:1789578788.277994:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.278002:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.278014:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.278036:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.278041:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009175fcf/0xd90373d592f20820 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789578788.278060:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789578788.300825:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a29694d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6467:x1876509277028608:12345-0@lo:253: Request processed in 45070us (45482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578788.301144:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a431223 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028608:0@lo:253: 10000000:01000000:2.0:1789578788.301167:0:6467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789578788.301171:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789578788.301173:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789578788.301175:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789578788.301176:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789578788.301178:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789578788.301179:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789578788.301180:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789578788.301182:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789578788.301183:0:6467:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789578788.301185:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789578788.301187:0:6467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789578788.301211:0:6467:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000097a8d9cc from lustre-MDT0000 10000000:01000000:2.0:1789578788.301253:0:6467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789578788.301257:0:6467:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789578788.301262:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93941008b380 10000000:01000000:2.0:1789578788.301267:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789578788.301302:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93941008b380 from 1 10000000:01000000:2.0:1789578788.301306:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789578788.301615:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789578788.301868:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.301882:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.301894:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.301929:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a431223 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028736:0@lo:101: 00000100:00100000:2.0:1789578788.301988:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.302049:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f07d0fe0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578788.302092:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277028736 00000100:00100000:3.0:1789578788.302108:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277028736 00000100:00100000:3.0:1789578788.302192:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789578788.302201:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008314d5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6467:x1876509277028736:12345-0@lo:101: 00010000:00010000:3.0:1789578788.302219:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578788.302237:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20827 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.302263:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20827 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.302273:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20827 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.302295:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000e8e973, rc 0) 00000100:00100000:3.0:1789578788.302445:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008314d5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6467:x1876509277028736:12345-0@lo:101: Request processed in 245us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578788.302452:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578788.305077:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a431223 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028736:0@lo:101: 00010000:00010000:1.0:1789578788.305117:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.305130:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578788.306049:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028864:0@lo:501: 00000100:00100000:1.0:1789578788.306154:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.306220:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c74a3ce9 going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.306575:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277028864 00000100:00100000:0.0:1789578788.306586:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277028864 00000100:00100000:0.0:1789578788.306710:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789578788.306721:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f9dc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6467:x1876509277028864:12345-0@lo:501: 00000100:00100000:0.0:1789578788.306858:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f9dc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6467:x1876509277028864:12345-0@lo:501: Request processed in 139us (705us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789578788.306867:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789578788.306966:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028864:0@lo:501: 10000000:01000000:1.0:1789578788.307010:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789578788.307038:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.307051:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578788.307062:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93940679b000 10000000:01000000:1.0:1789578788.307069:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789578788.307075:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93940679b000 10000000:01000000:1.0:1789578788.307079:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789578788.307083:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93940679b000 from 1 10000000:01000000:1.0:1789578788.307087:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789578788.307137:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.307146:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.307156:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578788.307173:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028992:0@lo:101: 00000100:00100000:1.0:1789578788.307205:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.308219:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c74a3ce9 going to sleep for 11 seconds 00000100:00100000:3.0:1789578788.308333:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277028992 00000100:00100000:3.0:1789578788.308344:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277028992 00000100:00100000:3.0:1789578788.308401:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789578788.308408:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081cdfa68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6467:x1876509277028992:12345-0@lo:101: 00010000:00010000:3.0:1789578788.308424:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578788.308443:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000086051e6/0xd90373d592f2083c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20835 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.308484:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000086051e6/0xd90373d592f2083c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20835 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.308497:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000086051e6/0xd90373d592f2083c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20835 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.308507:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000086051e6, rc 0) 00000100:00100000:3.0:1789578788.308581:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081cdfa68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+7:6467:x1876509277028992:12345-0@lo:101: Request processed in 173us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578788.308587:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578788.308760:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277028992:0@lo:101: 00010000:00010000:1.0:1789578788.308777:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.308786:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578788.308805:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789578788.308820:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.308828:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000002cf276b1/0xd90373d592f20835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578788.308844:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789578788.308850:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789578788.308857:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93940679b000 10000000:01000000:1.0:1789578788.308859:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789578788.308877:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789578788.308880:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789578788.309050:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.309058:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.309067:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578788.309087:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029120:0@lo:101: 00000100:00100000:1.0:1789578788.309125:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.309158:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c74a3ce9 going to sleep for 11 seconds 00000100:00100000:3.0:1789578788.309422:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029120 00000100:00100000:3.0:1789578788.309429:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029120 00000100:00100000:3.0:1789578788.309477:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578788.309485:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bdb4d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+7:6467:x1876509277029120:12345-0@lo:101: 00010000:00010000:3.0:1789578788.309496:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578788.309518:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20843 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.309536:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20843 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.309544:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20843 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.309551:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009896fd75, rc 0) 00000100:00100000:3.0:1789578788.309595:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bdb4d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+8:6467:x1876509277029120:12345-0@lo:101: Request processed in 112us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578788.309601:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789578788.309737:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029120:0@lo:101: 00010000:00010000:1.0:1789578788.309749:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.309757:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578788.309823:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029248:0@lo:501: 00000100:00100000:1.0:1789578788.309863:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.309888:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c74a3ce9 going to sleep for 11 seconds 00000100:00100000:2.0:1789578788.309950:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029248 00000100:00100000:2.0:1789578788.309965:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029248 00000100:00100000:2.0:1789578788.310036:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789578788.310047:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e84f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+8:6467:x1876509277029248:12345-0@lo:501: 00000100:00100000:2.0:1789578788.310434:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e84f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6467:x1876509277029248:12345-0@lo:501: Request processed in 389us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578788.310441:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789578788.310620:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029248:0@lo:501: 00000100:00100000:1.0:1789578788.310668:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029376:0@lo:503: 00000100:00100000:1.0:1789578788.310726:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.310754:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c74a3ce9 going to sleep for 11 seconds 00000100:00100000:3.0:1789578788.311182:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029376 00000100:00100000:3.0:1789578788.311193:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029376 00000100:00100000:3.0:1789578788.311407:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578788.311418:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011aa0986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6467:x1876509277029376:12345-0@lo:503: 00000100:00100000:3.0:1789578788.311597:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011aa0986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6467:x1876509277029376:12345-0@lo:503: Request processed in 181us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578788.311604:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789578788.311868:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029376:0@lo:503: 00000100:00100000:0.0:1789578788.312787:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6512:1876509277029504:0@lo:502: 00000100:00100000:0.0:1789578788.313070:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578788.313119:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1a3ca85 going to sleep for 11 seconds 00000100:00100000:2.0:1789578788.313321:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029504 00000100:00100000:2.0:1789578788.313332:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029504 00000100:00100000:2.0:1789578788.313436:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789578788.313447:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000671d9872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6512:x1876509277029504:12345-0@lo:502: 00000100:00100000:2.0:1789578788.313615:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000671d9872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6512:x1876509277029504:12345-0@lo:502: Request processed in 170us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578788.313623:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789578788.314686:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6512:1876509277029504:0@lo:502: 00000020:01000000:0.0:1789578788.314747:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578788.314764:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578788.314768:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789578788.314774:0:6512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789578788.314779:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789578788.314799:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000082d6c974) 00000020:00000080:0.0:1789578788.315183:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789578788.315195:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789578788.317275:0:6512:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789578788.317301:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f20858 00000020:00000080:2.0:1789578788.317823:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789578788.317838:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578788.317845:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.317847:0:6512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789578788.317851:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578788.317858:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.317860:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789578788.317864:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789578788.317878:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000391664bf) 00000020:00000080:2.0:1789578788.317896:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789578788.317902:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789578788.317904:0:6512:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789578788.317907:0:6512:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789578788.317915:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789578788.317984:0:6512:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000097a8d9cc from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789578788.317999:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f20256fe) 00000020:00000080:2.0:1789578788.318006:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789578788.318109:0:6512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789578788.318116:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f2086d 00000020:00000080:2.0:1789578788.318236:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789578788.318244:0:6512:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789578788.318248:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd90373d592f20874 00080000:01000000:2.0:1789578788.318254:0:6512:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789578788.318533:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f2087b 00080000:10000000:2.0:1789578788.321728:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789578788.322105:0:6512:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789578788.329919:0:6512:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789578788.469461:0:6512:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789578788.469779:0:6512:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789578788.472021:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789578788.472418:0:6512:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789578788.481886:0:6512:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000eb35ac72) 00000020:00000080:3.0:1789578788.481920:0:6512:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789578788.481992:0:6512:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789578788.481999:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f20889 00000020:00000080:3.0:1789578788.484568:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789578788.489664:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.496327:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.501883:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.508648:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.519130:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.522727:0:6512:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789578788.526115:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd90373d592f20890 00000020:00000080:2.0:1789578788.527539:0:6512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789578788.527569:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578788.527578:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.527580:0:6512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789578788.527583:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578788.527587:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.527589:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789578788.527592:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789578788.527594:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789578788.527598:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578788.527601:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.527602:0:6512:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789578788.527604:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578788.527609:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578788.527610:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789578788.527614:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789578788.527677:0:6512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789578788.527748:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004412556f pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6512:1876509277029632:0@lo:502: 00000100:00100000:2.0:1789578788.527852:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.527979:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e8b1272 going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.527997:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029632 00000100:00100000:0.0:1789578788.528012:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029632 00000100:00100000:0.0:1789578788.534805:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789578788.534830:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8de5203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6512:x1876509277029632:12345-0@lo:502: 00000100:00100000:0.0:1789578788.535043:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8de5203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6512:x1876509277029632:12345-0@lo:502: Request processed in 226us (7192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.535051:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578788.535204:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004412556f pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6512:1876509277029632:0@lo:502: 00000020:01000000:3.0:1789578788.535275:0:6512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578788.535289:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578788.535293:0:6512:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789578788.535299:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789578788.535946:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789578788.535977:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789578788.536021:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.536035:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578788.536044:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940679b000 from 1 10000000:01000000:1.0:1789578788.536048:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789578788.536102:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.536111:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.536120:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578788.536143:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029760:0@lo:101: 00000100:00100000:1.0:1789578788.536215:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578788.536291:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037eb1aae going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.536336:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029760 00000100:00100000:0.0:1789578788.536378:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029760 00000100:00100000:0.0:1789578788.536436:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789578788.536445:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ff8dccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+9:6467:x1876509277029760:12345-0@lo:101: 00010000:00010000:0.0:1789578788.536459:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578788.536477:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20897 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.536512:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20897 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.536525:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20897 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.536534:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009175fcf, rc 0) 00000100:00100000:0.0:1789578788.536605:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ff8dccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+10:6467:x1876509277029760:12345-0@lo:101: Request processed in 159us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.536612:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789578788.536756:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007de44eb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029760:0@lo:101: 00010000:00010000:2.0:1789578788.536777:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.536787:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.537575:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029888:0@lo:256: 00000100:00100000:2.0:1789578788.537640:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.537680:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:3.0:1789578788.537779:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277029888 00000100:00100000:3.0:1789578788.537788:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277029888 00000100:00100000:3.0:1789578788.537838:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578788.537846:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000064afaff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:6467:x1876509277029888:12345-0@lo:256: 20000000:01000000:3.0:1789578788.537871:0:6482:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789578788.537879:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789578788.537965:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000064afaff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:6467:x1876509277029888:12345-0@lo:256: Request processed in 120us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578788.537973:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789578788.538061:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277029888:0@lo:256: 10000000:01000000:2.0:1789578788.541645:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789578788.541723:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.541739:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578788.541748:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940679b000 from 1 10000000:01000000:2.0:1789578788.541751:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578788.541805:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.541814:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.541825:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.541854:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030016:0@lo:101: 00000100:00100000:2.0:1789578788.541942:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.542005:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.542057:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030016 00000100:00100000:0.0:1789578788.542073:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030016 00000100:00100000:0.0:1789578788.542164:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578788.542173:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000547c0aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+10:6467:x1876509277030016:12345-0@lo:101: 00010000:00010000:0.0:1789578788.542191:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578788.542209:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f208a5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.542236:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f208a5 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.542247:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208a5 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.542255:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000757765e, rc 0) 00000100:00100000:0.0:1789578788.542345:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000547c0aee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030016:12345-0@lo:101: Request processed in 173us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.542380:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789578788.542434:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030016:0@lo:101: 00010000:00010000:2.0:1789578788.542456:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.542466:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.542553:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030144:0@lo:501: 00000100:00100000:2.0:1789578788.542599:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.542629:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.543481:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030144 00000100:00100000:0.0:1789578788.543493:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030144 00000100:00100000:0.0:1789578788.543540:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789578788.543547:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079f159cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030144:12345-0@lo:501: 00000100:00100000:0.0:1789578788.543728:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079f159cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030144:12345-0@lo:501: Request processed in 182us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.543736:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789578788.543986:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030144:0@lo:501: 00000100:00100000:2.0:1789578788.544048:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030272:0@lo:503: 00000100:00100000:2.0:1789578788.544128:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.544175:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.547527:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030272 00000100:00100000:0.0:1789578788.547552:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030272 00000100:00100000:0.0:1789578788.547645:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789578788.547656:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fdc7c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030272:12345-0@lo:503: 00000040:00080000:0.0:1789578788.547741:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789578788.547866:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fdc7c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030272:12345-0@lo:503: Request processed in 213us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.547875:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789578788.547987:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030272:0@lo:503: 00000040:00080000:1.0:1789578788.550230:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789578788.550979:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789578788.551020:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578788.555806:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.555827:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578788.555916:0:6467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789578788.555919:0:6467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93940679b000 10000000:01000000:2.0:1789578788.555923:0:6467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93940679b000 10000000:01000000:2.0:1789578788.555928:0:6467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789578788.555935:0:6467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940679b000 from 1 10000000:01000000:2.0:1789578788.555938:0:6467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789578788.555976:0:6467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.555984:0:6467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.555994:0:6467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.556034:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030400:0@lo:101: 00000100:00100000:2.0:1789578788.556103:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578788.556164:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030400 00000100:00100000:0.0:1789578788.556180:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030400 00000100:00100000:0.0:1789578788.556267:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578788.556280:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000694319d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6467:x1876509277030400:12345-0@lo:101: 00000100:00100000:2.0:1789578788.556284:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00010000:00010000:0.0:1789578788.556303:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578788.556338:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f208b3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.556408:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.556430:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.556440:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfaa1899, rc 0) 00000100:00100000:0.0:1789578788.556511:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000694319d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277030400:12345-0@lo:101: Request processed in 235us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.556518:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789578788.557004:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030400:0@lo:101: 00010000:00010000:2.0:1789578788.557025:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.557036:0:6467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578788.557103:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030528:0@lo:501: 00000100:00100000:2.0:1789578788.557138:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.557239:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:1.0:1789578788.559772:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030528 00000100:00100000:1.0:1789578788.559793:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030528 00000100:00100000:1.0:1789578788.559871:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789578788.559881:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085689d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277030528:12345-0@lo:501: 00000100:00100000:1.0:1789578788.560112:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085689d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277030528:12345-0@lo:501: Request processed in 232us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578788.560136:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789578788.560777:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030528:0@lo:501: 00000100:00100000:2.0:1789578788.560849:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030656:0@lo:503: 00000100:00100000:2.0:1789578788.560915:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.560961:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 000000007eac208b going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.561032:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030656 00000100:00100000:0.0:1789578788.561039:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030656 00000100:00100000:0.0:1789578788.561095:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789578788.561104:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8dcb26d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277030656:12345-0@lo:503: 00000100:00100000:0.0:1789578788.561221:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8dcb26d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277030656:12345-0@lo:503: Request processed in 119us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.561228:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789578788.562650:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0810138 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277030656:0@lo:503: 00000100:00100000:2.0:1789578788.564035:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299a721f pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6517:1876509277030784:0@lo:502: 00000100:00100000:2.0:1789578788.564147:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.564197:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071152bd4 going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.564314:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030784 00000100:00100000:0.0:1789578788.564330:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030784 00000100:00100000:1.0:1789578788.564596:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789578788.564610:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e903b989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6517:x1876509277030784:12345-0@lo:502: 00000100:00100000:1.0:1789578788.564777:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e903b989 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6517:x1876509277030784:12345-0@lo:502: Request processed in 170us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578788.564786:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789578788.564983:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299a721f pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6517:1876509277030784:0@lo:502: 00000020:01000004:2.0:1789578788.565072:0:6517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789578788.565117:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c01ffbdb) 00000020:00000080:2.0:1789578788.565146:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789578788.565542:0:6517:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000097a8d9cc from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789578788.565554:0:6517:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000097a8d9cc from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789578788.565557:0:6517:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000097a8d9cc 4 00010000:00080000:2.0:1789578788.565595:0:6517:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c5f6b584@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789578788.570498:0:6517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789578788.570793:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789578788.570844:0:6517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789578788.570860:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd90373d592f208c8 00000100:00080000:2.0:1789578788.570873:0:6517:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789578788.570886:0:6517:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c5f6b584 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789578788.570936:0:6517:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000299a721f x1876509277030912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789578788.570964:0:6517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789578788.571216:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6517:1876509277031040:0@lo:502: 00000100:00100000:3.0:1789578788.574071:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299a721f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277030912:0@lo:38: 00000100:00100000:2.0:1789578788.580346:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578788.584765:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578788.584884:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277030912 00000100:00100000:3.0:1789578788.584896:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277030912 00000100:00100000:3.0:1789578788.584941:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578788.584949:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efe81b4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277030912:12345-0@lo:38: 00000100:00100000:3.0:1789578788.585026:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efe81b4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277030912:12345-0@lo:38: Request processed in 76us (274us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789578788.585035:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789578788.587275:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031040 00000100:00100000:2.0:1789578788.587294:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031040 00000100:00100000:2.0:1789578788.587390:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789578788.587401:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ef5881a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6517:x1876509277031040:12345-0@lo:502: 00000100:00100000:2.0:1789578788.588527:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ef5881a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6517:x1876509277031040:12345-0@lo:502: Request processed in 1121us (8186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578788.588541:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789578788.588636:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8523290 going to sleep for 11 seconds 00000100:00100000:2.0:1789578788.588667:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:6517:1876509277031040:0@lo:502: 00000040:00080000:2.0:1789578788.588711:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1789578788.589515:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789578788.589525:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000c5f6b584 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789578788.589540:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789578788.589544:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299a721f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277030912:0@lo:38: 00000020:01000000:3.0:1789578788.589668:0:6467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789578788.589705:0:6467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789578788.589728:0:6467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578788.589741:0:6467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789578788.589804:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789578788.589807:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789578788.589809:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578788.589810:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578788.589812:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578788.589813:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578788.589814:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789578788.589816:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789578788.589817:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578788.589819:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578788.589821:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578788.589822:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789578788.589826:0:6467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789578788.589829:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789578788.589831:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789578788.589832:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578788.589833:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578788.589834:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578788.589835:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578788.589836:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789578788.589837:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789578788.589838:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578788.589839:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578788.589840:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578788.589841:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789578788.589874:0:6467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789578788.589897:0:6467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa5975c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277031168:0@lo:253: 00000100:00100000:3.0:1789578788.589965:0:6467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578788.594509:0:6467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003851b26 going to sleep for 11 seconds 00000100:00100000:0.0:1789578788.594701:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031168 00000100:00100000:0.0:1789578788.594715:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031168 00000100:00100000:0.0:1789578788.594793:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578788.594803:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f71a3167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277031168:12345-0@lo:253: 20000000:01000000:0.0:1789578788.594848:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789578788.594869:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789578788.608929:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789578788.608957:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789578788.609620:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f71a3167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6467:x1876509277031168:12345-0@lo:253: Request processed in 14812us (19648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578788.609653:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789578788.609715:0:6467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa5975c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:6467:1876509277031168:0@lo:253: 10000000:01000000:3.0:1789578788.609739:0:6467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789578788.609742:0:6467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789578788.609744:0:6467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789578788.609745:0:6467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578788.609746:0:6467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578788.609747:0:6467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578788.609748:0:6467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578788.609750:0:6467:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789578788.609752:0:6467:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789578788.609753:0:6467:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578788.609754:0:6467:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578788.609755:0:6467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578788.609757:0:6467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789578788.609839:0:6467:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789578788.609841:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789578788.609853:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789578788.609883:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.609903:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20897 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.609911:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.609958:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.609975:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 11 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578788.609988:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277031296:0@lo:104: 00000100:00100000:0.0:1789578788.610031:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578788.610093:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e625566f going to sleep for 11 seconds 00000100:00100000:1.0:1789578788.610332:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031296 00000100:00100000:1.0:1789578788.610562:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031296 00000100:00100000:1.0:1789578788.610624:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578788.610634:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c464e5b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277031296:12345-0@lo:104: 00010000:00010000:1.0:1789578788.610650:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578788.610799:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578788.610805:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c464e5b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277031296:12345-0@lo:104: Request processed in 173us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578788.610812:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789578788.610878:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578788.610885:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.610910:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f576358 already unused, calling callback (00000000e50f8cad) 10000000:00010000:0.0:1789578788.610913:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.610922:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578788.610929:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578788.610935:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789578788.610980:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.610988:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578788.611021:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611029:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 000000008f576358/0xd90373d592f20897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2089e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611052:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578788.611054:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578788.611056:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578788.611162:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a002642 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277031424:0@lo:103: 00000100:00100000:1.0:1789578788.611204:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578788.611214:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277031296:0@lo:104: 00010000:00010000:2.0:1789578788.611239:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578788.611315:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031424 00000100:00100000:0.0:1789578788.611323:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031424 00010000:00010000:0.0:1789578788.611380:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 12 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578788.611410:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789578788.611435:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040cbf7cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3616:x1876509277031424:12345-0@lo:103: 00010000:00010000:0.0:1789578788.611448:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578788.611453:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 12 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611464:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 12 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611475:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009175fcf/0xd90373d592f2089e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20897 expref: 12 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611490:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611498:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789578788.611512:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001660757s 00010000:00010000:0.0:1789578788.611516:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611523:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611529:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611535:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611539:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d21f81d already unused, calling callback (00000000151b4d03) 00010000:00010000:0.0:1789578788.611548:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611557:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611571:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578788.611581:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578788.611614:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040cbf7cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+11:3616:x1876509277031424:12345-0@lo:103: Request processed in 183us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578788.611620:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578788.611978:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a002642 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277031424:0@lo:103: 00010000:00010000:2.0:1789578788.612493:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.612506:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578788.612512:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d21f81d/0xd90373d592f208cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789578788.619718:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.620171:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789578788.620484:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.620682:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789578788.622136:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.622512:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789578788.624683:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.625061:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789578788.625268:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.625597:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789578788.626459:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789578788.626711:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789578788.641151:0:6467:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789578788.668283:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789578788.669626:0:6523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1789578788.669823:0:6522:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789578788.669829:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789578788.674769:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789578788.675103:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789578788.675672:0:6467:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789578788.675683:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789578788.678773:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789578788.681379:0:6467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789578788.685953:0:6467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789578788.686094:0:6467:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789578788.686680:0:6467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789578788.688062:0:6467:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1789578788.692041:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789578788.692220:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789578788.692411:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789578788.692535:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789578788.692670:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789578788.692837:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789578788.692987:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789578788.693131:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789578788.693263:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000040:00080000:1.0:1789578788.698547:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1789578788.705346:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789578788.713799:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789578788.715796:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789578788.716348:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789578788.716516:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789578788.718514:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789578788.718699:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789578788.719324:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789578788.719519:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789578788.725800:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789578788.727767:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789578788.729277:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789578788.730664:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789578788.731732:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789578788.732740:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789578788.734392:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789578788.736793:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789578788.737780:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789578788.739478:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000040:00080000:1.0:1789578788.739683:0:6523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789578788.739752:0:6523:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789578788.739757:0:6523:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1789578788.741704:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789578788.742230:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789578788.742435:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789578788.742593:0:6467:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789578788.742789:0:6467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789578788.745987:0:6467:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789578788.746027:0:6467:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd9781cc7988 00100000:10000000:2.0:1789578788.746035:0:6467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789578788.747255:0:6467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789578788.747273:0:6467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789578788.747442:0:6467:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789578788.747459:0:6467:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789578788.749835:0:6467:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578788.750068:0:6467:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789578788.965615:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578789.987478:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578791.011802:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578792.036744:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578793.059554:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789578793.174201:0:6768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1789578793.827640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789578793.827650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789578793.827653:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c5f6b584 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789578793.827668:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c5f6b584 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578793.827690:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000260e5ccd x1876509277031680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789578793.827727:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000260e5ccd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277031680:0@lo:38: 00000100:00100000:0.0:1789578793.827788:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578793.828391:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578793.828401:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060f04339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277031552:0@lo:400: 00000100:00100000:2.0:1789578793.828449:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578793.828474:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031680 00000100:00100000:0.0:1789578793.828483:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031680 00000100:00100000:2.0:1789578793.828484:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031552 00000100:00100000:2.0:1789578793.828486:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031552 00000100:00100000:2.0:1789578793.828518:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578793.828521:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789578793.828526:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005cd3a6ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+11:3618:x1876509277031552:12345-0@lo:400: 00000100:00100000:0.0:1789578793.828535:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008065d012 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277031680:12345-0@lo:38: 00010000:00080000:0.0:1789578793.828555:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000100:00100000:2.0:1789578793.828572:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005cd3a6ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+11:3618:x1876509277031552:12345-0@lo:400: Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578793.828584:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:0.0:1789578793.828595:0:6492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd90373d592f208d6 00000100:00100000:2.0:1789578793.828627:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060f04339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277031552:0@lo:400: 00000004:00100000:0.0:1789578793.828635:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789578793.828739:0:6492:0:(import.c:65:import_set_state_nolock()) 000000000c2db4df : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578793.828785:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008065d012 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876509277031680:12345-0@lo:38: Request processed in 249us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578793.828792:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789578793.830755:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000260e5ccd x1876509277031680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789578793.830777:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789578793.830786:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789578793.830791:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789578793.830793:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000c5f6b584 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789578793.830800:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000260e5ccd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277031680:0@lo:38: 00010000:00010000:0.0:1789578794.083819:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789578794.206696:0:6820:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578794.206954:0:6820:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789578795.108227:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789578795.363493:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789578795.363505:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940679b000 from 3 10000000:01000000:1.0:1789578795.363512:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789578795.363579:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578795.363603:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578795.363615:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578795.363644:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277031808:0@lo:101: 00000100:00100000:1.0:1789578795.363744:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578795.363886:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c42925f0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578795.368850:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031808 00000100:00100000:2.0:1789578795.368872:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031808 00000100:00100000:2.0:1789578795.369560:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789578795.369575:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000396e06a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+11:6487:x1876509277031808:12345-0@lo:101: 00010000:00010000:2.0:1789578795.369609:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578795.369636:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f208dd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578795.369672:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f208dd expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578795.369685:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208dd expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578795.369695:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae481367, rc 0) 00000100:00100000:2.0:1789578795.369795:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000396e06a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6487:x1876509277031808:12345-0@lo:101: Request processed in 224us (6053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578795.369820:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789578795.369934:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277031808:0@lo:101: 00010000:00010000:1.0:1789578795.369958:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578795.369968:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578795.370045:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277031936:0@lo:256: 00000100:00100000:1.0:1789578795.370111:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578795.371899:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277031936 00000100:00100000:0.0:1789578795.371920:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277031936 00000100:00100000:3.0:1789578795.372005:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789578795.372020:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a9e8628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6487:x1876509277031936:12345-0@lo:256: 20000000:01000000:3.0:1789578795.372056:0:6482:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789578795.372094:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789578795.372097:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789578795.372253:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a9e8628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:6487:x1876509277031936:12345-0@lo:256: Request processed in 237us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578795.372270:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789578795.373537:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c42925f0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578795.373577:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277031936:0@lo:256: 10000000:01000000:1.0:1789578795.373830:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789578795.373842:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578795.373855:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578796.131582:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789578796.937238:0:6921:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578796.938047:0:6921:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789578797.162536:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578798.180415:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578798.958001:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578798.958026:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa5975c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277032064:0@lo:400: 00000100:00100000:3.0:1789578798.958113:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578798.958179:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578798.958189:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277032192:0@lo:400: 00000100:00100000:3.0:1789578798.958221:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578798.958265:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032192 00000100:00100000:3.0:1789578798.958273:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032192 00000100:00100000:3.0:1789578798.958321:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578798.958330:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079d08473 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277032192:12345-0@lo:400: 00000100:00100000:3.0:1789578798.958405:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079d08473 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277032192:12345-0@lo:400: Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578798.958411:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789578798.958453:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4e85274 x1876509277032192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578798.958467:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277032192:0@lo:400: 00000100:00100000:0.0:1789578798.958678:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032064 00000100:00100000:0.0:1789578798.958684:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032064 00000100:00100000:0.0:1789578798.958722:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789578798.958728:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078643bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3617:x1876509277032064:12345-0@lo:400: 00000100:00100000:0.0:1789578798.958769:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078643bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3617:x1876509277032064:12345-0@lo:400: Request processed in 42us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578798.958775:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789578798.958817:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa5975c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277032064:0@lo:400: 00010000:00010000:2.0:1789578799.203776:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578800.229102:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578801.253262:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578802.285219:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578803.304105:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578804.067944:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277032448:0@lo:400: 00000100:00100000:1.0:1789578804.068033:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578804.068125:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032448 00000100:00100000:3.0:1789578804.068232:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277032320:0@lo:400: 00000100:00100000:3.0:1789578804.068272:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578804.068314:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032320 00000100:00100000:3.0:1789578804.068318:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032320 00000100:00100000:3.0:1789578804.068388:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789578804.068397:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000683d6f7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3616:x1876509277032320:12345-0@lo:400: 00000100:00100000:3.0:1789578804.068443:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000683d6f7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3616:x1876509277032320:12345-0@lo:400: Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578804.068450:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789578804.068496:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015b2cf3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277032320:0@lo:400: 00000100:00100000:1.0:1789578804.068814:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032448 00000100:00100000:1.0:1789578804.068844:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578804.068850:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084216fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277032448:12345-0@lo:400: 00000100:00100000:1.0:1789578804.068888:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084216fcc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277032448:12345-0@lo:400: Request processed in 38us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578804.068893:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789578804.068920:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000021d66b20 x1876509277032448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578804.068930:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277032448:0@lo:400: 00010000:00010000:1.0:1789578804.323790:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578805.352641:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578806.374899:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789578807.019523:0:7420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789578807.019528:0:7420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789578807.019529:0:7420:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789578807.019688:0:7420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002922cbad 00000020:01000004:2.0:1789578807.019937:0:7420:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789578807.019950:0:7420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789578807.019967:0:7420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000041efaf67) 00000020:00000080:2.0:1789578807.019983:0:7420:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789578807.084848:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789578807.084936:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789578807.131223:0:7420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789578807.133737:0:7420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789578807.133752:0:7420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789578807.133765:0:7420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f208f2 00000020:01000004:0.0:1789578807.133781:0:7420:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789578807.133802:0:7420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789578807.133805:0:7420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789578807.133811:0:7420:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789578807.133843:0:7420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789578807.133846:0:7420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789578807.174708:0:7420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789578807.174748:0:7420:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789578807.174752:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789578807.174755:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789578807.174756:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789578807.174758:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789578807.174759:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789578807.174760:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789578807.174762:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789578807.174764:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789578807.174765:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789578807.174766:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789578807.174768:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789578807.174772:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789578807.174775:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789578807.174776:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789578807.174777:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789578807.174779:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789578807.174780:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789578807.174781:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789578807.174782:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789578807.174783:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789578807.174784:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789578807.174785:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789578807.174785:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789578807.174813:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789578807.174830:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054c2094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277032576:0@lo:253: 00000100:00100000:0.0:1789578807.174899:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.175003:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb8e79a0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.175748:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032576 00000100:00100000:3.0:1789578807.175766:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032576 00000100:00100000:3.0:1789578807.175858:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789578807.175867:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020d29790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277032576:12345-0@lo:253: 20000000:01000000:3.0:1789578807.175898:0:6482:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789578807.175903:0:6482:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789578807.175908:0:6482:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789578807.175911:0:6482:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789578807.175947:0:6482:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789578807.176182:0:6482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578807.176312:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789578807.176327:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789578807.176344:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789578807.176549:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789578807.176564:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789578807.176615:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789578807.176621:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789578807.176631:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789578807.176636:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789578807.176645:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789578807.176649:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789578807.176659:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789578807.176670:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789578807.176752:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789578807.176760:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:3.0:1789578807.176769:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789578807.176775:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789578807.176784:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789578807.176789:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:3.0:1789578807.176798:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789578807.176802:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789578807.176812:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789578807.176834:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789578807.176842:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789578807.176907:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789578807.176914:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789578807.176924:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789578807.176938:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789578807.176950:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789578807.176955:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789578807.176964:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789578807.176980:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789578807.176984:0:6482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789578807.177296:0:6482:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789578807.177304:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789578807.177851:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789578807.178234:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789578807.178265:0:6482:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.137@tcp for mdt 20000000:01000000:3.0:1789578807.178267:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:3.0:1789578807.178284:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789578807.178291:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789578807.178305:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789578807.178310:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:3.0:1789578807.178327:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789578807.178335:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789578807.178702:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789578807.178737:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789578807.178802:0:6482:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789578807.178811:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789578807.179098:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789578807.179902:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789578807.179925:0:6482:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.137@tcp for mdt 20000000:01000000:2.0:1789578807.179927:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:2.0:1789578807.179943:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789578807.179948:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789578807.179958:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789578807.179963:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:2.0:1789578807.179974:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789578807.179980:0:6482:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789578807.179990:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789578807.180002:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789578807.180020:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789578807.180030:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789578807.180033:0:6482:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789578807.180079:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789578807.180081:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789578807.180626:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789578807.180652:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789578807.180665:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789578807.180853:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789578807.180871:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789578807.180908:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789578807.180919:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789578807.180921:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789578807.181234:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789578807.181254:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789578807.181268:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1789578807.181614:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789578807.181636:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789578807.181653:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1789578807.181664:0:6482:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789578807.181666:0:6482:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789578807.181912:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789578807.181931:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789578807.181945:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789578807.182093:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789578807.182111:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789578807.182125:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789578807.182137:0:6482:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789578807.182139:0:6482:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789578807.182144:0:6482:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789578807.182150:0:6482:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789578807.182577:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789578807.182692:0:6482:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789578807.196002:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789578807.197153:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197187:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20827 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197194:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20843 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197218:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197226:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197268:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197284:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.197298:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277032704:0@lo:104: 00000100:00100000:3.0:1789578807.197376:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578807.197422:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.197430:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.197439:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277032832:0@lo:104: 00000100:00100000:1.0:1789578807.197566:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032704 00000100:00100000:1.0:1789578807.197581:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032704 00000100:00100000:1.0:1789578807.197641:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578807.197649:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000102cd1f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6482:x1876509277032704:12345-0@lo:104: 00010000:00010000:1.0:1789578807.197661:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197725:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578807.197730:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000102cd1f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6482:x1876509277032704:12345-0@lo:104: Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.197737:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789578807.197757:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789578807.197762:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197769:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008b519b7d already unused, calling callback (00000000e50f8cad) 10000000:00010000:1.0:1789578807.197772:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197779:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578807.197785:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578807.197790:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789578807.197815:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197822:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578807.197838:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197850:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 000000008b519b7d/0xd90373d592f208b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ba expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.197861:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578807.197863:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578807.197864:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578807.197886:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277032960:0@lo:103: 00000100:00100000:1.0:1789578807.197914:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.197960:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032960 00000100:00100000:1.0:1789578807.197965:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032960 00010000:00010000:1.0:1789578807.197980:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578807.198001:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578807.198007:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039e8daa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3618:x1876509277032960:12345-0@lo:103: 00010000:00010000:1.0:1789578807.198016:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578807.198020:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.198029:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.198043:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578807.198069:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039e8daa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3618:x1876509277032960:12345-0@lo:103: Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.198075:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578807.198109:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277032960:0@lo:103: 00000100:00100000:3.0:1789578807.198275:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578807.198307:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.198316:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.198325:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277033088:0@lo:104: 00000100:00100000:3.0:1789578807.198418:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.198486:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dffdb6c going to sleep for 11 seconds 00010000:00010000:3.0:1789578807.198498:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfaa1899/0xd90373d592f208ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f208b3 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.198508:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277032704:0@lo:104: 00000100:00100000:2.0:1789578807.198859:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277032832 00000100:00100000:2.0:1789578807.198865:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277032832 00000100:00100000:2.0:1789578807.198888:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033088 00000100:00100000:2.0:1789578807.198891:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033088 00000100:00100000:2.0:1789578807.198903:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578807.198909:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e7e42b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6482:x1876509277032832:12345-0@lo:104: 00010000:00010000:2.0:1789578807.198918:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.198980:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789578807.198984:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e7e42b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6482:x1876509277032832:12345-0@lo:104: Request processed in 76us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.198990:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578807.199004:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578807.199009:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b0ec5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6482:x1876509277033088:12345-0@lo:104: 00010000:00010000:2.0:1789578807.199015:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199043:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789578807.199047:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b0ec5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6482:x1876509277033088:12345-0@lo:104: Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.199052:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789578807.199065:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789578807.199069:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199076:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000473d36d4 already unused, calling callback (00000000e50f8cad) 10000000:00010000:2.0:1789578807.199079:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199086:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578807.199091:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.199096:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578807.199123:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199129:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578807.199143:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199148:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2084a expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199159:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578807.199161:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199167:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6521e38 already unused, calling callback (00000000e50f8cad) 10000000:00010000:2.0:1789578807.199180:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199186:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578807.199192:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.199197:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578807.199208:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199214:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578807.199217:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199233:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 00000000b6521e38/0xd90373d592f20827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2082e expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199245:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578807.199247:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578807.199248:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578807.199260:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277033216:0@lo:103: 00000100:00100000:2.0:1789578807.199286:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.199306:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578807.199312:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2c14e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277033344:0@lo:103: 00000100:00100000:2.0:1789578807.199331:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.199382:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033216 00000100:00100000:2.0:1789578807.199386:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033216 00010000:00010000:2.0:1789578807.199401:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.199418:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033344 00000100:00100000:2.0:1789578807.199421:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033344 00010000:00010000:2.0:1789578807.199429:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.199440:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578807.199445:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4005623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3615:x1876509277033216:12345-0@lo:103: 00010000:00010000:2.0:1789578807.199464:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578807.199475:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199484:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 13 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199504:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578807.199531:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4005623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3615:x1876509277033216:12345-0@lo:103: Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.199537:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578807.199549:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578807.199554:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3a61bba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3615:x1876509277033344:12345-0@lo:103: 00010000:00010000:2.0:1789578807.199561:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578807.199564:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199572:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 12 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199582:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199589:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199599:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199605:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199611:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199615:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199626:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098f6463f already unused, calling callback (00000000151b4d03) 00010000:00010000:2.0:1789578807.199629:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199636:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199643:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.199652:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578807.199674:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3a61bba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3615:x1876509277033344:12345-0@lo:103: Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.199680:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578807.199888:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2c14e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277033344:0@lo:103: 00000100:00100000:2.0:1789578807.199896:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277033216:0@lo:103: 00010000:00010000:2.0:1789578807.199914:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578807.199996:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009896fd75/0xd90373d592f2084a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20843 expref: 11 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.200007:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277032832:0@lo:104: 00010000:00010000:3.0:1789578807.200013:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000e8e973/0xd90373d592f2082e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20827 expref: 10 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.200019:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6482:1876509277033088:0@lo:104: 00010000:00010000:3.0:1789578807.200040:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.200047:0:6482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.200052:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.200057:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098f6463f/0xd90373d592f208f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789578807.200069:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789578807.207718:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020d29790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:7420:x1876509277032576:12345-0@lo:253: Request processed in 31844us (32810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.207734:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789578807.207857:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054c2094 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277032576:0@lo:253: 10000000:01000000:1.0:1789578807.207876:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789578807.207880:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789578807.207881:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789578807.207883:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578807.207884:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789578807.207885:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578807.207886:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578807.207887:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789578807.207889:0:7420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789578807.207890:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578807.207892:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789578807.207910:0:7420:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002922cbad from lustre-MDT0001 10000000:01000000:1.0:1789578807.207945:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789578807.207948:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789578807.207954:0:7420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93941008b380 local copy 10000000:01000000:1.0:1789578807.207959:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789578807.207993:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.208003:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.208011:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578807.208028:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033472:0@lo:101: 00000100:00100000:1.0:1789578807.208061:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.208108:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea63a7ac going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.208669:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033472 00000100:00100000:3.0:1789578807.208677:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033472 00000100:00100000:3.0:1789578807.208723:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789578807.208732:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ec98c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+9:7420:x1876509277033472:12345-0@lo:101: 00010000:00010000:3.0:1789578807.208745:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578807.208760:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002f6dea6/0xd90373d592f20907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20900 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.208785:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002f6dea6/0xd90373d592f20907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20900 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.208797:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002f6dea6/0xd90373d592f20907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20900 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.208805:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002f6dea6, rc 0) 00000100:00100000:3.0:1789578807.208844:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ec98c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+10:7420:x1876509277033472:12345-0@lo:101: Request processed in 114us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.208851:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789578807.208975:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033472:0@lo:101: 00010000:00010000:1.0:1789578807.208989:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.209008:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578807.209101:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033600:0@lo:501: 00000100:00100000:1.0:1789578807.209127:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.209150:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea63a7ac going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.209229:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033600 00000100:00100000:3.0:1789578807.209234:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033600 00000100:00100000:3.0:1789578807.209266:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789578807.209273:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001eb8f49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:7420:x1876509277033600:12345-0@lo:501: 00000100:00100000:3.0:1789578807.209334:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001eb8f49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:7420:x1876509277033600:12345-0@lo:501: Request processed in 62us (207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789578807.209341:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789578807.209428:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021d66b20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033600:0@lo:501: 10000000:01000000:2.0:1789578807.209441:0:7420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789578807.209459:0:7420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789578807.209464:0:7420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209471:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209477:0:7420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209505:0:7420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789578807.209531:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93940f42d800 10000000:01000000:2.0:1789578807.209536:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789578807.209541:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93941008b380 10000000:01000000:2.0:1789578807.209544:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789578807.209547:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93941008b380 from 1 10000000:01000000:2.0:1789578807.209550:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789578807.209605:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209613:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209619:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.209631:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033728:0@lo:101: 00000100:00100000:2.0:1789578807.209659:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.209676:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042a63025 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.209690:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033728 00000100:00100000:2.0:1789578807.209694:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033728 00000100:00100000:2.0:1789578807.209716:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789578807.209721:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9268039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+10:7420:x1876509277033728:12345-0@lo:101: 00010000:00010000:2.0:1789578807.209728:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578807.209737:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0403ee7/0xd90373d592f20915 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2090e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209750:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0403ee7/0xd90373d592f20915 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2090e expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209765:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0403ee7/0xd90373d592f20915 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2090e expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209771:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0403ee7, rc 0) 00000100:00100000:2.0:1789578807.209801:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9268039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+11:7420:x1876509277033728:12345-0@lo:101: Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.209807:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789578807.209838:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033728:0@lo:101: 00010000:00010000:2.0:1789578807.209848:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209855:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.209868:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789578807.209876:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209883:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000006bf88cfd/0xd90373d592f2090e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.209890:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93940f42d800 10000000:01000000:2.0:1789578807.209893:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789578807.209896:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93940f42d800 from 1 10000000:01000000:2.0:1789578807.209898:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789578807.209910:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209926:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.209933:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.209945:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033856:0@lo:101: 00000100:00100000:2.0:1789578807.209969:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.209981:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042a63025 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.210002:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033856 00000100:00100000:2.0:1789578807.210005:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033856 00000100:00100000:2.0:1789578807.210022:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789578807.210027:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000511f9a9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+11:7420:x1876509277033856:12345-0@lo:101: 00010000:00010000:2.0:1789578807.210034:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578807.210041:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2e902dc/0xd90373d592f20923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2091c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210054:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2e902dc/0xd90373d592f20923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2091c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210062:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2e902dc/0xd90373d592f20923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2091c expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210068:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2e902dc, rc 0) 00000100:00100000:2.0:1789578807.210094:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000511f9a9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277033856:12345-0@lo:101: Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.210100:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789578807.210129:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033856:0@lo:101: 00010000:00010000:2.0:1789578807.210144:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210151:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.210160:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789578807.210179:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210186:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000009d4b3a38/0xd90373d592f2091c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578807.210192:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789578807.210195:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789578807.210199:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93940f42d800 10000000:01000000:2.0:1789578807.210201:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789578807.210204:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789578807.210206:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789578807.210217:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210224:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210230:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.210241:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033984:0@lo:101: 00000100:00100000:2.0:1789578807.210265:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.210285:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042a63025 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.210301:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277033984 00000100:00100000:2.0:1789578807.210305:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277033984 00000100:00100000:2.0:1789578807.210323:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789578807.210327:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be20c669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277033984:12345-0@lo:101: 00010000:00010000:2.0:1789578807.210334:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578807.210387:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb01eea3/0xd90373d592f20931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2092a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210401:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb01eea3/0xd90373d592f20931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2092a expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210408:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb01eea3/0xd90373d592f20931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2092a expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210414:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb01eea3, rc 0) 00000100:00100000:2.0:1789578807.210441:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be20c669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277033984:12345-0@lo:101: Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.210447:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789578807.210477:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277033984:0@lo:101: 00010000:00010000:2.0:1789578807.210487:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.210493:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.210559:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034112:0@lo:501: 00000100:00100000:2.0:1789578807.210582:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.210594:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e09c3b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.210613:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034112 00000100:00100000:2.0:1789578807.210616:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034112 00000100:00100000:2.0:1789578807.210633:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789578807.210637:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e17505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034112:12345-0@lo:501: 00000100:00100000:2.0:1789578807.210723:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e17505 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034112:12345-0@lo:501: Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.210729:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789578807.210756:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034112:0@lo:501: 00000100:00100000:2.0:1789578807.210789:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034240:0@lo:503: 00000100:00100000:2.0:1789578807.210823:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.210836:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e09c3b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.210848:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034240 00000100:00100000:2.0:1789578807.210852:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034240 00000100:00100000:2.0:1789578807.210867:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789578807.210871:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007ffb96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034240:12345-0@lo:503: 00000100:00100000:2.0:1789578807.210939:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007ffb96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034240:12345-0@lo:503: Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.210945:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789578807.210983:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034240:0@lo:503: 00000040:00080000:2.0:1789578807.211228:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789578807.211299:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034368:0@lo:502: 00000100:00100000:2.0:1789578807.211331:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.211345:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e09c3b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.211383:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034368 00000100:00100000:2.0:1789578807.211387:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034368 00000100:00100000:2.0:1789578807.211405:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789578807.211410:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000625bcd77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034368:12345-0@lo:502: 00000100:00100000:2.0:1789578807.211489:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000625bcd77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034368:12345-0@lo:502: Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.211495:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789578807.211532:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034368:0@lo:502: 00000040:00080000:2.0:1789578807.211710:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789578807.211734:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789578807.211749:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789578807.211761:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789578807.211775:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789578807.211789:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789578807.211803:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789578807.211821:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789578807.211835:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789578807.211847:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789578807.211859:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789578807.211869:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789578807.211880:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789578807.211892:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789578807.211905:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789578807.211919:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789578807.211932:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789578807.211946:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789578807.211958:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789578807.211971:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789578807.211984:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789578807.211997:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789578807.212009:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789578807.212027:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034496:0@lo:502: 00000100:00100000:2.0:1789578807.212061:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.212076:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e09c3b2 going to sleep for 11 seconds 00010000:00010000:3.0:1789578807.212303:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578807.212310:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212331:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c4b2ea4 already unused, calling callback (00000000e50f8cad) 10000000:00010000:3.0:1789578807.212334:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212343:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578807.212365:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578807.212372:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578807.212392:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212399:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578807.212419:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212426:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 000000003c4b2ea4/0xd90373d592f20900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20907 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212442:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578807.212444:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578807.212445:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578807.212456:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277034624:0@lo:103: 00000100:00100000:3.0:1789578807.212485:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.212530:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034624 00000100:00100000:3.0:1789578807.212536:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034624 00000100:00100000:3.0:1789578807.212568:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578807.212581:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4644a66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3617:x1876509277034624:12345-0@lo:103: 00010000:00010000:3.0:1789578807.212591:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578807.212605:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002f6dea6/0xd90373d592f20907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20900 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.212617:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578807.212645:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4644a66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+12:3617:x1876509277034624:12345-0@lo:103: Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.212650:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578807.212681:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277034624:0@lo:103: 00000100:00100000:3.0:1789578807.212696:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034496 00000100:00100000:3.0:1789578807.212700:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034496 00000100:00100000:3.0:1789578807.212714:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789578807.212719:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cccec57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277034496:12345-0@lo:502: 00000100:00100000:3.0:1789578807.212793:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cccec57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277034496:12345-0@lo:502: Request processed in 74us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.212799:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578807.219277:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed8d282c pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034496:0@lo:502: 00000040:00080000:2.0:1789578807.219399:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789578807.219413:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789578807.221529:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578807.221545:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578807.221547:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789578807.221554:0:7432:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789578807.221558:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789578807.221573:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000def0160d) 00000020:00000080:2.0:1789578807.221596:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789578807.221602:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789578807.221707:0:7432:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789578807.221716:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f2093f 00000020:00000080:2.0:1789578807.221945:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789578807.221950:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578807.221954:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578807.221956:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789578807.221959:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578807.221962:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578807.221964:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789578807.221967:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789578807.221974:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000bbcc27a) 00000020:00000080:2.0:1789578807.221985:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789578807.221990:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789578807.221991:0:7432:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789578807.221994:0:7432:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789578807.222000:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789578807.222046:0:7432:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002922cbad from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789578807.222067:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000e2381c76) 00000020:00000080:2.0:1789578807.222078:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789578807.222166:0:7432:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789578807.222184:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20954 00000020:00000080:2.0:1789578807.222276:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789578807.222288:0:7432:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789578807.222293:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd90373d592f2095b 00080000:01000000:2.0:1789578807.222299:0:7432:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789578807.222302:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f20962 00080000:10000000:2.0:1789578807.222852:0:7432:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789578807.222989:0:7432:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789578807.294496:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1789578807.294858:0:7432:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789578807.297915:0:7432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789578807.298319:0:7432:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789578807.310773:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789578807.310788:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578807.310798:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578807.310800:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789578807.310805:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578807.310812:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578807.310813:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789578807.310816:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789578807.310821:0:7432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:1.0:1789578807.310852:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789578807.310890:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000003f7899) 00000020:00000080:1.0:1789578807.311596:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789578807.311610:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789578807.311698:0:7432:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789578807.311705:0:7432:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789578807.311711:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f20970 00010000:00080000:1.0:1789578807.311749:0:7432:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cfb88a2a@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789578807.313309:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789578807.319013:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789578807.319028:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789578807.319067:0:7432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789578807.319102:0:7432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20977 00000100:00080000:3.0:1789578807.319114:0:7432:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789578807.319125:0:7432:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000cfb88a2a using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789578807.319161:0:7432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a7b2d5c5 x1876509277034752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789578807.319199:0:7432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789578807.319268:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578807.319277:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319279:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789578807.319282:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789578807.319285:0:7432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789578807.319287:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789578807.319288:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789578807.319290:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789578807.319292:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319293:0:7432:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789578807.319295:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578807.319301:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319302:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789578807.319306:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789578807.319344:0:7432:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789578807.319397:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578807.319401:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319402:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789578807.319405:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578807.319407:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319408:0:7432:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789578807.319411:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789578807.319413:0:7432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789578807.319444:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578807.319447:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578807.319449:0:7432:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789578807.319452:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789578807.319515:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789578807.319542:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789578807.319556:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.319568:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000994480a9/0xd90373d592f2092a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578807.319586:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940f42d800 from 1 10000000:01000000:3.0:1789578807.319589:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789578807.319613:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.319620:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.319631:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.319649:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034880:0@lo:101: 00000100:00100000:1.0:1789578807.319838:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277035008:0@lo:400: 00000100:00100000:2.0:1789578807.319933:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277034752:0@lo:38: 00000100:00100000:1.0:1789578807.320314:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.320807:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035008 00000100:00100000:0.0:1789578807.320816:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035008 00000100:00100000:0.0:1789578807.320870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789578807.320879:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be7c8fb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277035008:12345-0@lo:400: 00000100:00100000:0.0:1789578807.320938:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be7c8fb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277035008:12345-0@lo:400: Request processed in 61us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578807.320945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789578807.321034:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.321063:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c803c87c going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.321094:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034880 00000100:00100000:3.0:1789578807.321099:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034880 00000100:00100000:3.0:1789578807.321127:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578807.321133:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008287e79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+12:7420:x1876509277034880:12345-0@lo:101: 00010000:00010000:3.0:1789578807.321141:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578807.321155:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2097e expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.321189:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2097e expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.321200:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2097e expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.321208:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098f6463f, rc 0) 00000100:00100000:3.0:1789578807.321246:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008287e79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277034880:12345-0@lo:101: Request processed in 114us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.321252:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578807.321298:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277034880:0@lo:101: 00010000:00010000:3.0:1789578807.321314:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.321323:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789578807.321829:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c1799b11 x1876509277035008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578807.321843:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277035008:0@lo:400: 00000100:00100000:3.0:1789578807.323123:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035136:0@lo:256: 00000100:00100000:3.0:1789578807.323204:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.323291:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c803c87c going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.324008:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.324580:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277034752 00000100:00100000:1.0:1789578807.324590:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277034752 00000100:00100000:1.0:1789578807.324627:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578807.324633:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8d282c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277034752:12345-0@lo:38: 00010000:00080000:1.0:1789578807.324657:0:6495:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1789578807.324692:0:6495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f2098c 00000004:00100000:1.0:1789578807.324773:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789578807.324779:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789578807.325006:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035136 00000100:00100000:1.0:1789578807.325011:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035136 00000100:00100000:1.0:1789578807.325079:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789578807.325087:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000503c0974 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277035136:12345-0@lo:256: 20000000:01000000:1.0:1789578807.325105:0:6484:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789578807.325127:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789578807.325130:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789578807.325270:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000503c0974 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277035136:12345-0@lo:256: Request processed in 184us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.325278:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789578807.325370:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4e85274 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035136:0@lo:256: 10000000:01000000:0.0:1789578807.325953:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789578807.325978:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578807.325991:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578807.326000:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f42d800 from 1 10000000:01000000:0.0:1789578807.326670:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789578807.326708:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578807.326717:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578807.326726:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578807.326745:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035264:0@lo:101: 00000100:00100000:0.0:1789578807.326795:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.327249:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007cff306 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.327459:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035264 00000100:00100000:3.0:1789578807.327469:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035264 00000100:00100000:3.0:1789578807.327507:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578807.327514:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c1c309f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277035264:12345-0@lo:101: 00010000:00010000:3.0:1789578807.327526:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578807.327538:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20993 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.327560:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20993 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.327570:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20993 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.327578:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000e8e973, rc 0) 00000100:00100000:3.0:1789578807.327660:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c1c309f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035264:12345-0@lo:101: Request processed in 147us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.327678:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789578807.327862:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035264:0@lo:101: 00010000:00010000:0.0:1789578807.327876:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578807.327883:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578807.327976:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035392:0@lo:501: 00000100:00100000:0.0:1789578807.328002:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.328030:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007cff306 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.328070:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035392 00000100:00100000:3.0:1789578807.328074:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035392 00000100:00100000:3.0:1789578807.328101:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789578807.328107:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b50486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035392:12345-0@lo:501: 00000100:00100000:3.0:1789578807.328303:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b50486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035392:12345-0@lo:501: Request processed in 196us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.328310:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578807.328445:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035392:0@lo:501: 00000100:00100000:0.0:1789578807.328472:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035520:0@lo:503: 00000100:00100000:0.0:1789578807.328511:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.328526:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007cff306 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.328598:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035520 00000100:00100000:1.0:1789578807.328603:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035520 00000100:00100000:1.0:1789578807.328630:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789578807.328636:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078f53fd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035520:12345-0@lo:503: 00000040:00080000:1.0:1789578807.328668:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789578807.328720:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078f53fd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035520:12345-0@lo:503: Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.328732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578807.328861:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee88561a pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035520:0@lo:503: 00000040:00080000:0.0:1789578807.329142:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789578807.329261:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789578807.329339:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789578807.330333:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789578807.333378:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789578807.333412:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789578807.333427:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.333440:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578807.334054:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789578807.334060:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93940f42d800 10000000:01000000:3.0:1789578807.334062:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93940f42d800 10000000:01000000:3.0:1789578807.334066:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789578807.334072:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940f42d800 from 1 10000000:01000000:3.0:1789578807.334075:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578807.334111:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.334120:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.334130:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.334162:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015b3fb3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035648:0@lo:101: 00000100:00100000:3.0:1789578807.334240:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.334282:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c770a3 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.334336:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035648 00000100:00100000:1.0:1789578807.334343:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035648 00000100:00100000:1.0:1789578807.334405:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578807.334413:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e147fbb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:7420:x1876509277035648:12345-0@lo:101: 00010000:00010000:1.0:1789578807.334427:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578807.334439:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f576358/0xd90373d592f209a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f209a1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.334460:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f576358/0xd90373d592f209a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f209a1 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.335162:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f576358/0xd90373d592f209a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209a1 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.335182:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f576358, rc 0) 00000100:00100000:1.0:1789578807.335603:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e147fbb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277035648:12345-0@lo:101: Request processed in 1190us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.335611:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789578807.335690:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015b3fb3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035648:0@lo:101: 00010000:00010000:3.0:1789578807.335768:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.335778:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.335879:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015b3fb3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035776:0@lo:501: 00000100:00100000:3.0:1789578807.335911:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.335976:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1c770a3 going to sleep for 11 seconds 00000100:00080000:2.0:1789578807.336971:0:6495:0:(import.c:65:import_set_state_nolock()) 00000000d5d5b15d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578807.337025:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8d282c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277034752:12345-0@lo:38: Request processed in 12392us (13019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.337038:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789578807.337136:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789578807.337145:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789578807.337151:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789578807.337156:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789578807.337158:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000cfb88a2a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789578807.337182:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b2d5c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277034752:0@lo:38: 00000100:00100000:0.0:1789578807.337318:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578807.337328:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2c14e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277035904:0@lo:41: 00000100:00100000:0.0:1789578807.337381:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.337568:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035904 00000100:00100000:2.0:1789578807.337575:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035904 00000100:00100000:2.0:1789578807.337615:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789578807.337623:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee88561a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277035904:12345-0@lo:41: 00000004:00000024:2.0:1789578807.337648:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789578807.337684:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee88561a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277035904:12345-0@lo:41: Request processed in 63us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.337691:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789578807.337844:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2c14e65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277035904:0@lo:41: 00000100:00100000:1.0:1789578807.338832:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277035776 00000100:00100000:1.0:1789578807.338841:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277035776 00000100:00100000:1.0:1789578807.338970:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578807.338978:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df589949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277035776:12345-0@lo:501: 00000100:00100000:1.0:1789578807.339125:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df589949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277035776:12345-0@lo:501: Request processed in 149us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.339133:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789578807.339216:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015b3fb3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277035776:0@lo:501: 00000100:00100000:0.0:1789578807.339259:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036032:0@lo:503: 00000100:00100000:0.0:1789578807.339311:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.339728:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007cff306 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.339871:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036032 00000100:00100000:3.0:1789578807.339878:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036032 00000100:00100000:3.0:1789578807.339908:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789578807.339914:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000554e72c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036032:12345-0@lo:503: 00000100:00100000:3.0:1789578807.340011:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000554e72c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036032:12345-0@lo:503: Request processed in 97us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.340018:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578807.340100:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036032:0@lo:503: 00000040:00080000:0.0:1789578807.340403:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789578807.340480:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036160:0@lo:502: 00000100:00100000:0.0:1789578807.340519:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.340538:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000723b5c20 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.340690:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036160 00000100:00100000:1.0:1789578807.340958:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036160 00000100:00100000:1.0:1789578807.340995:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789578807.341001:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a0a20bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036160:12345-0@lo:502: 00000100:00100000:1.0:1789578807.341100:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a0a20bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036160:12345-0@lo:502: Request processed in 99us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.341108:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789578807.341284:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036160:0@lo:502: 00000040:00080000:0.0:1789578807.341604:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789578807.341642:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789578807.341659:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789578807.341674:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789578807.341688:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789578807.341787:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789578807.341806:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789578807.341820:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789578807.341834:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789578807.341849:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789578807.341863:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789578807.341878:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789578807.341891:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789578807.341906:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789578807.341918:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789578807.341932:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789578807.341946:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789578807.341958:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789578807.341969:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789578807.341984:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789578807.341995:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789578807.342005:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789578807.342017:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789578807.342029:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789578807.342041:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789578807.342054:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789578807.342067:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789578807.342079:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789578807.342110:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036288:0@lo:502: 00000100:00100000:0.0:1789578807.342160:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.342211:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000723b5c20 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.342318:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036288 00000100:00100000:3.0:1789578807.342324:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036288 00000100:00100000:3.0:1789578807.342377:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789578807.342383:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dde0c846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036288:12345-0@lo:502: 00000100:00100000:3.0:1789578807.342536:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dde0c846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036288:12345-0@lo:502: Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.342552:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789578807.342855:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003c8ac201 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036288:0@lo:502: 00000040:00080000:0.0:1789578807.342912:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789578807.342927:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789578807.345268:0:7438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789578807.345288:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d00a577e) 00000020:00000080:3.0:1789578807.345310:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789578807.345568:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002922cbad from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789578807.345573:0:7438:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002922cbad from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789578807.345575:0:7438:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002922cbad 3 00010000:00080000:3.0:1789578807.345607:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ebc0ce3d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578807.347988:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789578807.348276:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789578807.348318:0:7438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789578807.348333:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd90373d592f209b6 00000100:00080000:3.0:1789578807.348344:0:7438:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789578807.348397:0:7438:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ebc0ce3d using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789578807.348436:0:7438:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000072e09a3f x1876509277036416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789578807.348454:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789578807.348813:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072e09a3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277036416:0@lo:38: 00000100:00100000:0.0:1789578807.348877:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.348971:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036416 00000100:00100000:1.0:1789578807.348979:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036416 00000100:00100000:1.0:1789578807.349014:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578807.349020:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c8ac201 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277036416:12345-0@lo:38: 00010000:00080000:1.0:1789578807.349042:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1789578807.349084:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd90373d592f209bd 00000004:00100000:1.0:1789578807.349097:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789578807.349135:0:6491:0:(import.c:65:import_set_state_nolock()) 00000000408ceb64 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789578807.349212:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c8ac201 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876509277036416:12345-0@lo:38: Request processed in 190us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.349220:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789578807.349258:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000072e09a3f x1876509277036416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578807.349268:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789578807.349275:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789578807.349282:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789578807.349285:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789578807.349287:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000ebc0ce3d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789578807.349293:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072e09a3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277036416:0@lo:38: 00000040:00080000:3.0:1789578807.349551:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789578807.349884:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789578807.349913:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789578807.349947:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578807.349958:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 000000009896fd75/0xd90373d592f209a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789578807.350060:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789578807.350072:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789578807.350074:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789578807.350075:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789578807.350076:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789578807.350078:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789578807.350078:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789578807.350080:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789578807.350081:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789578807.350082:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789578807.350084:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789578807.350087:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789578807.350090:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789578807.350091:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789578807.350092:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789578807.350092:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789578807.350093:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789578807.350094:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789578807.350095:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789578807.350096:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789578807.350097:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789578807.350098:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789578807.350098:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789578807.350132:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789578807.350161:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036544:0@lo:253: 00000100:00100000:0.0:1789578807.350225:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578807.350270:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000723b5c20 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.350435:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036544 00000100:00100000:3.0:1789578807.350442:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036544 00000100:00100000:3.0:1789578807.350507:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789578807.350515:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f089720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7420:x1876509277036544:12345-0@lo:253: 20000000:01000000:3.0:1789578807.350535:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789578807.350548:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1789578807.351016:0:7439:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:3.0:1789578807.352978:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789578807.353085:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789578807.353103:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789578807.353304:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789578807.353309:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789578807.353329:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353347:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208dd expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353390:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353407:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353445:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353459:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.353472:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c9225a4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277036672:0@lo:104: 00000100:00100000:2.0:1789578807.353533:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578807.353579:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.353587:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 15 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.353594:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277036800:0@lo:104: 00000100:00100000:2.0:1789578807.353614:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.353627:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019812265 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.354066:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036672 00000100:00100000:1.0:1789578807.354079:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036672 00000100:00100000:1.0:1789578807.354110:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036800 00000100:00100000:1.0:1789578807.354112:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036800 00000100:00100000:1.0:1789578807.354122:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578807.354127:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f7d91f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277036672:12345-0@lo:104: 00010000:00010000:1.0:1789578807.354138:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354208:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578807.354212:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f7d91f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277036672:12345-0@lo:104: Request processed in 85us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.354219:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578807.354233:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789578807.354238:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001dab8f46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277036800:12345-0@lo:104: 00010000:00010000:1.0:1789578807.354244:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354273:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789578807.354277:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001dab8f46 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277036800:12345-0@lo:104: Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.354282:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789578807.354383:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789578807.354388:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354395:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002f6dea6 already unused, calling callback (00000000e50f8cad) 10000000:00010000:1.0:1789578807.354397:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354412:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578807.354418:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578807.354424:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789578807.354452:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354459:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578807.354473:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354481:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 0000000002f6dea6/0xd90373d592f2097e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20985 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354493:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789578807.354495:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354501:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ccded71f already unused, calling callback (00000000e50f8cad) 10000000:00010000:1.0:1789578807.354502:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354508:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578807.354513:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578807.354524:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789578807.354536:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354542:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578807.354554:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354560:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 00000000ccded71f/0xd90373d592f208dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208e4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354574:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578807.354575:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578807.354577:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578807.354587:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008955f6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277037056:0@lo:103: 00000100:00100000:1.0:1789578807.354615:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.354657:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037056 00000100:00100000:1.0:1789578807.354661:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037056 00010000:00010000:1.0:1789578807.354677:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 16 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578807.354809:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c9225a4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277036672:0@lo:104: 00000100:00100000:2.0:1789578807.354817:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277036800:0@lo:104: 00010000:00010000:2.0:1789578807.354833:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578807.354876:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578807.354886:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000995d4963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3617:x1876509277037056:12345-0@lo:103: 00010000:00010000:1.0:1789578807.354898:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578807.354902:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 16 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354911:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 16 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354929:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae481367/0xd90373d592f208e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f208dd expref: 16 pid: 6484 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578807.354942:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578807.354976:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000995d4963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3617:x1876509277037056:12345-0@lo:103: Request processed in 94us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578807.354983:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578807.355009:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277036928:0@lo:103: 00000100:00100000:1.0:1789578807.355031:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.355333:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008955f6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277037056:0@lo:103: 00010000:00010000:3.0:1789578807.355467:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578807.355484:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277036928 00000100:00100000:3.0:1789578807.355489:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277036928 00010000:00010000:3.0:1789578807.355514:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578807.355543:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578807.355549:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f606088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3616:x1876509277036928:12345-0@lo:103: 00010000:00010000:3.0:1789578807.355558:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578807.355561:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355569:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355578:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098f6463f/0xd90373d592f20985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2097e expref: 15 pid: 6482 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355588:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355595:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789578807.355608:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002299171s 00010000:00010000:3.0:1789578807.355612:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355618:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355623:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355629:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355641:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ae693b1 already unused, calling callback (00000000151b4d03) 00010000:00010000:3.0:1789578807.355644:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355651:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355660:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578807.355669:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578807.355715:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f606088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:3616:x1876509277036928:12345-0@lo:103: Request processed in 167us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.355721:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578807.355824:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f089720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:7420:x1876509277036544:12345-0@lo:253: Request processed in 5310us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.355832:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789578807.355863:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277036928:0@lo:103: 00000100:00100000:3.0:1789578807.355890:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:7420:1876509277036544:0@lo:253: 10000000:01000000:3.0:1789578807.355899:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789578807.355902:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789578807.355904:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789578807.355905:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578807.355906:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578807.355907:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578807.355908:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578807.355909:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789578807.355911:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578807.355912:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578807.355913:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578807.355921:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789578807.355930:0:7420:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789578807.356260:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.356277:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578807.356283:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ae693b1/0xd90373d592f209c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789578807.366077:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.366555:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789578807.367939:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.368921:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789578807.369163:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.372214:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789578807.375120:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.375434:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789578807.375634:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.375816:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789578807.375972:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789578807.376132:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1789578807.384892:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1789578807.385286:0:7444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1789578807.385450:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8fefd12 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1876509277037184:0@lo:700: 00000100:00100000:0.0:1789578807.385792:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.386158:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037184 00000100:00100000:2.0:1789578807.386176:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037184 00000100:00100000:2.0:1789578807.386265:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789578807.386277:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035575685 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1876509277037184:12345-0@lo:700: 00000100:00100000:0.0:1789578807.386733:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007cff306 going to sleep for 11 seconds 00000040:01000000:1.0:1789578807.387328:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789578807.388022:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037312:0@lo:1000: 00000100:00100000:1.0:1789578807.388850:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.388903:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a5165a9 going to sleep for 11 seconds 00000100:00100000:2.0:1789578807.388973:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037312 00000100:00100000:2.0:1789578807.388980:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037312 00000100:00100000:2.0:1789578807.389029:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578807.389035:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037312:12345-0@lo:1000: 00000100:00100000:2.0:1789578807.389126:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037312:12345-0@lo:1000: Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.389133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00080000:3.0:1789578807.389263:0:7443:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789578807.389268:0:7443:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789578807.389272:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037312:0@lo:1000: 00000040:01000000:1.0:1789578807.389306:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789578807.389340:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037440:0@lo:700: 00000100:00100000:1.0:1789578807.389399:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.389423:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d36777e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.389914:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037440 00000100:00100000:3.0:1789578807.389919:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037440 00000100:00100000:3.0:1789578807.389957:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578807.389964:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006a213ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037440:12345-0@lo:700: 00000100:00100000:3.0:1789578807.390012:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006a213ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037440:12345-0@lo:700: Request processed in 50us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.390018:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578807.390260:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037440:0@lo:700: 00000040:01000000:0.0:1789578807.390285:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789578807.390306:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1876509277037568:0@lo:900: 00000100:00100000:1.0:1789578807.390336:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.390377:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d36777e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.390471:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037568 00000100:00100000:3.0:1789578807.390476:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037568 00000100:00100000:3.0:1789578807.390502:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578807.390508:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002389578b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1876509277037568:12345-0@lo:900: 00000100:00100000:3.0:1789578807.390554:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002389578b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1876509277037568:12345-0@lo:900: Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.390569:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789578807.390670:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb1b2394 x1876509277037568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789578823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578807.390681:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1876509277037568:0@lo:900: 00000100:00100000:2.0:1789578807.390823:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037696:0@lo:1000: 00000100:00100000:2.0:1789578807.390854:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.390915:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa89d1b4 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.390959:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037696 00000100:00100000:3.0:1789578807.390964:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037696 00000100:00100000:3.0:1789578807.391023:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789578807.391029:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c9225a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037696:12345-0@lo:1000: 00000100:00100000:3.0:1789578807.391099:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c9225a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037696:12345-0@lo:1000: Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.391106:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578807.391159:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037696:0@lo:1000: 00000004:00080000:2.0:1789578807.391238:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c6030d61 with version 0 00000020:00100000:2.0:1789578807.391261:0:7445:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789578807.391266:0:7445:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005fd4fe26 x1876509277037952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789578807.391278:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037952:0@lo:1000: 00000100:00100000:2.0:1789578807.391376:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578807.391866:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028aeadf5 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.391939:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277037952 00000100:00100000:1.0:1789578807.391944:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277037952 00000100:00100000:1.0:1789578807.391970:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578807.391975:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe80b469 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037952:12345-0@lo:1000: 00000040:00080000:0.0:1789578807.392629:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789578807.393997:0:7420:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789578807.394013:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789578807.394268:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789578807.397145:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1789578807.397194:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1789578807.397539:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789578807.397777:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe80b469 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277037952:12345-0@lo:1000: Request processed in 5799us (6397us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789578807.397789:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1789578807.397898:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789578807.397903:0:7445:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789578807.397918:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fd4fe26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277037952:0@lo:1000: 00000100:00100000:3.0:1789578807.397999:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277038080:0@lo:1000: 00000100:00100000:3.0:1789578807.398034:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578807.398063:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038080 00000100:00100000:3.0:1789578807.398069:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038080 00000100:00100000:3.0:1789578807.398110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578807.398118:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e392660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277038080:12345-0@lo:1000: 00000100:00100000:3.0:1789578807.398209:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e392660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876509277038080:12345-0@lo:1000: Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578807.398216:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578807.398256:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6b6e883 going to sleep for 11 seconds 00000100:00100000:3.0:1789578807.398269:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1876509277038080:0@lo:1000: 00000040:00080000:3.0:1789578807.398297:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789578807.398298:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789578807.398334:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000004:00080000:3.0:1789578807.398389:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000230efb33 with version 1 00000040:00080000:0.0:1789578807.398667:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789578807.398991:0:7420:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000004:00080000:1.0:1789578807.399125:0:7435:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ba14b2c4 version 1 rpc_version 1 00000020:00100000:1.0:1789578807.399146:0:7435:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789578807.399252:0:7435:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005ece6081 x1876509277038336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789578807.399283:0:7435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1876509277038336:0@lo:1000: 00000100:00100000:1.0:1789578807.399447:0:7435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578807.399663:0:7435:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a5165a9 going to sleep for 11 seconds 00000100:00100000:1.0:1789578807.399698:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038336 00000100:00100000:1.0:1789578807.399705:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038336 00000100:00100000:1.0:1789578807.399752:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789578807.399758:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005493ea2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1876509277038336:12345-0@lo:1000: 00100000:10000000:0.0:1789578807.399988:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789578807.400226:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789578807.400673:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789578807.400912:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789578807.401544:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789578807.401729:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789578807.402003:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789578807.402307:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789578807.402613:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789578807.402745:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789578807.403015:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789578807.403223:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789578807.403412:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789578807.403715:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789578807.403974:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:2.0:1789578807.403998:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035575685 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1876509277037184:12345-0@lo:700: Request processed in 17721us (18297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578807.404011:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1789578807.404211:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789578807.404641:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789578807.404760:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789578807.404989:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789578807.405205:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789578807.405323:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789578807.405649:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789578807.405870:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789578807.405997:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789578807.406103:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789578807.406282:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789578807.406651:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789578807.406924:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00010000:00010000:2.0:1789578807.406958:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789578807.407000:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00100000:10000000:0.0:1789578807.407025:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000004:00080000:3.0:1789578807.407075:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789578807.407273:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00010000:00080000:1.0:1789578807.407325:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f8fefd12 x1876509277037184/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789578823 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578807.407342:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8fefd12 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1876509277037184:0@lo:700: 40000000:02000000:1.0:1789578807.407400:0:7444:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1789578807.407530:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00100000:10000000:0.0:1789578807.407600:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000100:00100000:2.0:1789578807.407642:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005493ea2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1876509277038336:12345-0@lo:1000: Request processed in 7883us (8193us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789578807.407652:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00100000:10000000:0.0:1789578807.407905:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789578807.408211:0:7420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:1.0:1789578807.414702:0:7435:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789578807.414713:0:7435:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789578807.414735:0:7435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1876509277038336:0@lo:1000: 00000001:00080000:1.0:1789578807.421238:0:7420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789578807.421279:0:7420:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbd97818a3988 00100000:10000000:1.0:1789578807.421288:0:7420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789578807.421945:0:7420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789578807.421979:0:7420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789578807.421996:0:7420:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789578807.422019:0:7420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789578807.422912:0:7420:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578807.425437:0:7420:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1789578807.454842:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789578807.463105:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789578807.463188:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789578807.463193:0:7444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1789578808.421836:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578809.443519:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578810.467500:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578811.500442:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789578811.956766:0:7689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789578812.515604:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789578812.771610:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789578812.771618:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940f42d800 from 4 10000000:01000000:1.0:1789578812.771623:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789578812.771667:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.771680:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.771692:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.771715:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277038464:0@lo:101: 00000100:00100000:1.0:1789578812.771784:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.771846:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.772022:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038464 00000100:00100000:2.0:1789578812.772032:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038464 00000100:00100000:2.0:1789578812.772094:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789578812.772103:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000083aaadb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+13:6487:x1876509277038464:12345-0@lo:101: 00010000:00010000:2.0:1789578812.772144:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578812.772158:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000704b81c8/0xd90373d592f209d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f209cb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.772181:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000704b81c8/0xd90373d592f209d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f209cb expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.772190:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000704b81c8/0xd90373d592f209d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209cb expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.772199:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000704b81c8, rc 0) 00000100:00100000:2.0:1789578812.772329:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000083aaadb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:6487:x1876509277038464:12345-0@lo:101: Request processed in 227us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.772336:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789578812.772872:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277038592:0@lo:400: 00000100:00100000:0.0:1789578812.772907:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.772951:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007e965eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277038720:0@lo:400: 00000100:00100000:0.0:1789578812.772976:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.772993:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578812.772997:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000754e338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277038848:0@lo:400: 00000100:00100000:0.0:1789578812.773014:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.773040:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038592 00000100:00100000:0.0:1789578812.773045:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038592 00000100:00100000:0.0:1789578812.773070:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038848 00000100:00100000:0.0:1789578812.773072:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038848 00000100:00100000:0.0:1789578812.773084:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789578812.773089:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002052c72e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277038592:12345-0@lo:400: 00000100:00100000:0.0:1789578812.773139:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002052c72e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277038592:12345-0@lo:400: Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.773145:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789578812.773161:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789578812.773167:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8fefd12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277038848:12345-0@lo:400: 00000100:00100000:0.0:1789578812.773195:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8fefd12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277038848:12345-0@lo:400: Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.773200:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789578812.773232:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d8ed4b88 x1876509277038592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578812.773246:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277038592:0@lo:400: 00010000:00080000:0.0:1789578812.773271:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000754e338c x1876509277038848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578812.773291:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000754e338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277038848:0@lo:400: 00000100:00100000:0.0:1789578812.773711:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277038976:0@lo:41: 00000100:00100000:0.0:1789578812.773750:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578812.773828:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038720 00000100:00100000:3.0:1789578812.773834:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038720 00000100:00100000:3.0:1789578812.773863:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277038976 00000100:00100000:3.0:1789578812.773866:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277038976 00000100:00100000:3.0:1789578812.773880:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578812.773885:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004eea311 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277038720:12345-0@lo:400: 00000100:00100000:3.0:1789578812.773943:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004eea311 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277038720:12345-0@lo:400: Request processed in 58us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578812.773950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578812.773975:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578812.773981:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000754e338c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277038976:12345-0@lo:41: 00000004:00000024:3.0:1789578812.774004:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789578812.774047:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000754e338c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277038976:12345-0@lo:41: Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578812.774053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789578812.774087:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4644a66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277038976:0@lo:41: 00000100:00100000:0.0:1789578812.774156:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007e965eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277038720:0@lo:400: 00000100:00100000:1.0:1789578812.774228:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277038464:0@lo:101: 00010000:00010000:1.0:1789578812.774248:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.774260:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.774453:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039104:0@lo:256: 00000100:00100000:1.0:1789578812.774487:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.774515:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:3.0:1789578812.775539:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039104 00000100:00100000:3.0:1789578812.775549:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039104 00000100:00100000:3.0:1789578812.775603:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789578812.775612:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b71fc212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:6487:x1876509277039104:12345-0@lo:256: 20000000:01000000:3.0:1789578812.775629:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789578812.775666:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789578812.775669:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789578812.775771:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b71fc212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:6487:x1876509277039104:12345-0@lo:256: Request processed in 161us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578812.775779:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789578812.776118:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039104:0@lo:256: 10000000:01000000:1.0:1789578812.776187:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789578812.776196:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.776205:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 0000000001f4ea13/0xd90373d592f209cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578812.776215:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789578812.776217:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940679b000 from 21 10000000:01000000:1.0:1789578812.776220:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789578812.776249:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.776256:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.776264:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.776485:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039232:0@lo:101: 00000100:00100000:1.0:1789578812.776522:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.776611:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.776687:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039232 00000100:00100000:2.0:1789578812.776693:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039232 00000100:00100000:2.0:1789578812.776760:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789578812.776768:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0680c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:6487:x1876509277039232:12345-0@lo:101: 00010000:00010000:2.0:1789578812.776777:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578812.776789:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be810752/0xd90373d592f209e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f209d9 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.776810:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be810752/0xd90373d592f209e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f209d9 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.776819:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be810752/0xd90373d592f209e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209d9 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.776839:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be810752, rc 0) 00000100:00100000:2.0:1789578812.776881:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0680c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039232:12345-0@lo:101: Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.776887:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789578812.776951:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039232:0@lo:101: 00010000:00010000:1.0:1789578812.776965:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.776973:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.777036:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039360:0@lo:501: 00000100:00100000:1.0:1789578812.777061:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.777143:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.777179:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039360 00000100:00100000:0.0:1789578812.777185:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039360 00000100:00100000:0.0:1789578812.777208:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789578812.777213:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000443d7eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039360:12345-0@lo:501: 00000100:00100000:0.0:1789578812.777373:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000443d7eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039360:12345-0@lo:501: Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.777380:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789578812.777448:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039360:0@lo:501: 00000100:00100000:1.0:1789578812.777474:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039488:0@lo:503: 00000100:00100000:1.0:1789578812.777512:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.777542:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.777648:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039488 00000100:00100000:0.0:1789578812.777654:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039488 00000100:00100000:0.0:1789578812.777674:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789578812.777679:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ff687b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039488:12345-0@lo:503: 00000100:00100000:0.0:1789578812.777763:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ff687b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039488:12345-0@lo:503: Request processed in 84us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.777770:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789578812.777867:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039488:0@lo:503: 00000100:00100000:2.0:1789578812.778341:0:7723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000061211041 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7723:1876509277039616:0@lo:502: 00000100:00100000:2.0:1789578812.778432:0:7723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578812.778484:0:7723:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092ec09c6 going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.778524:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039616 00000100:00100000:0.0:1789578812.778528:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039616 00000100:00100000:0.0:1789578812.778600:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578812.778607:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c13a7f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7723:x1876509277039616:12345-0@lo:502: 00000100:00100000:0.0:1789578812.778698:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c13a7f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7723:x1876509277039616:12345-0@lo:502: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.778704:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789578812.778779:0:7723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000061211041 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7723:1876509277039616:0@lo:502: 00000100:00100000:1.0:1789578812.778823:0:7723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7723:1876509277039744:0@lo:502: 00000100:00100000:1.0:1789578812.778856:0:7723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.778957:0:7723:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.778990:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039744 00000100:00100000:2.0:1789578812.778998:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039744 00000100:00100000:2.0:1789578812.779018:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789578812.779023:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aba57fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7723:x1876509277039744:12345-0@lo:502: 00000100:00100000:2.0:1789578812.779152:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aba57fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:7723:x1876509277039744:12345-0@lo:502: Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.779159:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789578812.779247:0:7723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7723:1876509277039744:0@lo:502: 00000040:00080000:1.0:1789578812.779267:0:7723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789578812.779784:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789578812.779803:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789578812.779812:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.779833:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000c68a69f7/0xd90373d592f209d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578812.779842:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789578812.779844:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940679b000 from 4 10000000:01000000:0.0:1789578812.779847:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789578812.779873:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.779880:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.779887:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578812.779900:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007e965eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039872:0@lo:101: 00000100:00100000:0.0:1789578812.779931:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.779998:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036593cca going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.780032:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277039872 00000100:00100000:2.0:1789578812.780037:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277039872 00000100:00100000:2.0:1789578812.780097:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789578812.780104:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b5119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277039872:12345-0@lo:101: 00010000:00010000:2.0:1789578812.780113:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578812.780124:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051549117/0xd90373d592f209ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f209e7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.780154:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051549117/0xd90373d592f209ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.780164:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051549117/0xd90373d592f209ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578812.780177:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051549117, rc 0) 00000100:00100000:2.0:1789578812.780241:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b5119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277039872:12345-0@lo:101: Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.780247:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789578812.780386:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007e965eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277039872:0@lo:101: 00010000:00010000:1.0:1789578812.780398:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.780406:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.780447:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040000:0@lo:256: 00000100:00100000:1.0:1789578812.780475:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.780495:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.780545:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040000 00000100:00100000:0.0:1789578812.780549:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040000 00000100:00100000:0.0:1789578812.780567:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789578812.780572:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a8171a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277040000:12345-0@lo:256: 20000000:01000000:0.0:1789578812.780583:0:6482:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789578812.780598:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789578812.780600:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789578812.780671:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a8171a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277040000:12345-0@lo:256: Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.780677:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789578812.780736:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040000:0@lo:256: 10000000:01000000:1.0:1789578812.780771:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789578812.780776:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.780782:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000d17c293a/0xd90373d592f209e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578812.780788:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789578812.780789:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789578812.780791:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789578812.780805:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.780811:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.780818:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.780828:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040128:0@lo:101: 00000100:00100000:1.0:1789578812.780853:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.780875:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.780917:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040128 00000100:00100000:0.0:1789578812.780921:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040128 00000100:00100000:0.0:1789578812.780938:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789578812.780942:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb29a39c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277040128:12345-0@lo:101: 00010000:00010000:0.0:1789578812.780948:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578812.780955:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d21f81d/0xd90373d592f209fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f209f5 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.780967:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d21f81d/0xd90373d592f209fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f209f5 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.780974:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d21f81d/0xd90373d592f209fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209f5 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.780979:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d21f81d, rc 0) 00000100:00100000:0.0:1789578812.781015:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb29a39c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277040128:12345-0@lo:101: Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.781019:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789578812.781072:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040128:0@lo:101: 00010000:00010000:1.0:1789578812.781083:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578812.781088:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578812.781148:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040256:0@lo:501: 00000100:00100000:1.0:1789578812.781169:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.781221:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.781272:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040256 00000100:00100000:2.0:1789578812.781285:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040256 00000100:00100000:2.0:1789578812.781303:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789578812.781308:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c3e669b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277040256:12345-0@lo:501: 00000100:00100000:2.0:1789578812.781542:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c3e669b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277040256:12345-0@lo:501: Request processed in 234us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.781549:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789578812.781619:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040256:0@lo:501: 00000100:00100000:1.0:1789578812.781644:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040384:0@lo:503: 00000100:00100000:1.0:1789578812.781678:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.781698:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5a1d35b going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.781745:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040384 00000100:00100000:2.0:1789578812.781749:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040384 00000100:00100000:2.0:1789578812.781766:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789578812.781770:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000055676c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277040384:12345-0@lo:503: 00000100:00100000:2.0:1789578812.781847:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000055676c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277040384:12345-0@lo:503: Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.781853:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789578812.781923:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277040384:0@lo:503: 00000100:00100000:1.0:1789578812.782294:0:7724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7724:1876509277040512:0@lo:502: 00000100:00100000:1.0:1789578812.782326:0:7724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.782374:0:7724:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a85d967 going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.782474:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040512 00000100:00100000:2.0:1789578812.782478:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040512 00000100:00100000:2.0:1789578812.782495:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789578812.782500:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000088c1dff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:7724:x1876509277040512:12345-0@lo:502: 00000100:00100000:2.0:1789578812.782575:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000088c1dff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:7724:x1876509277040512:12345-0@lo:502: Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.782581:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789578812.782649:0:7724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ece6081 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7724:1876509277040512:0@lo:502: 00000020:01000000:1.0:1789578812.782671:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578812.782680:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578812.782682:0:7724:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789578812.782687:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789578812.782690:0:7724:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:1.0:1789578812.782711:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789578812.782726:0:7724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000000f202491) 00000020:00000080:1.0:1789578812.782744:0:7724:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789578812.782750:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789578812.782829:0:7724:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789578812.782834:0:7724:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789578812.782841:0:7724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f20a0a 00010000:00080000:1.0:1789578812.782870:0:7724:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ea4f71fb@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789578812.784893:0:7724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789578812.787063:0:7724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789578812.787083:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789578812.787122:0:7724:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789578812.787154:0:7724:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20a11 00000100:00080000:2.0:1789578812.787165:0:7724:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789578812.787176:0:7724:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ea4f71fb using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789578812.787214:0:7724:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a2d9d010 x1876509277040640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789578812.787243:0:7724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789578812.787385:0:7724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1789578812.787825:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d9d010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277040640:0@lo:38: 00000100:00100000:1.0:1789578812.787891:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578812.787985:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040640 00000100:00100000:3.0:1789578812.787993:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040640 00000100:00100000:3.0:1789578812.788032:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578812.788038:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ece6081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277040640:12345-0@lo:38: 00010000:00080000:3.0:1789578812.788064:0:6495:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1789578812.788095:0:6495:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20a18 00000004:00100000:3.0:1789578812.788108:0:6495:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789578812.788113:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789578812.792190:0:7727:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d8ed4b88 x1876509277040768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578812.792209:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094809f06 going to sleep for 0 seconds 00000020:01000000:1.0:1789578812.792568:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578812.792575:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578812.792578:0:7724:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789578812.792582:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578812.792586:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578812.792587:0:7724:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789578812.792591:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789578812.792592:0:7724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789578812.792614:0:7724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059c7b9eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7724:1876509277040896:0@lo:502: 00000100:00100000:1.0:1789578812.792692:0:7724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578812.792778:0:7724:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb21bff4 going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.792817:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040896 00000100:00100000:2.0:1789578812.792825:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040896 00000100:00100000:2.0:1789578812.792930:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789578812.792940:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a311f8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:7724:x1876509277040896:12345-0@lo:502: 00000100:00100000:2.0:1789578812.793067:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a311f8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:7724:x1876509277040896:12345-0@lo:502: Request processed in 129us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.793074:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789578812.793162:0:7724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059c7b9eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:7724:1876509277040896:0@lo:502: 00000020:01000000:1.0:1789578812.793187:0:7724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578812.793191:0:7724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578812.793193:0:7724:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789578812.793196:0:7724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789578812.793524:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789578812.793543:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789578812.793551:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.793562:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000235cf7ba/0xd90373d592f209f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578812.793570:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789578812.793579:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93941008b380 from 1 10000000:01000000:0.0:1789578812.793581:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789578812.793607:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.793614:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.793622:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578812.793635:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277041024:0@lo:101: 00000100:00100000:0.0:1789578812.793665:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.796761:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036593cca going to sleep for 11 seconds 00000100:00100000:3.0:1789578812.796912:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041024 00000100:00100000:3.0:1789578812.796924:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041024 00000100:00100000:3.0:1789578812.796975:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789578812.796982:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff73ed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277041024:12345-0@lo:101: 00010000:00010000:3.0:1789578812.796996:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578812.797014:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8fc8d1c/0xd90373d592f20a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a1f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578812.797041:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8fc8d1c/0xd90373d592f20a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a1f expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578812.797051:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8fc8d1c/0xd90373d592f20a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a1f expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578812.797060:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8fc8d1c, rc 0) 00000100:00100000:3.0:1789578812.797116:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff73ed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277041024:12345-0@lo:101: Request processed in 135us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578812.797123:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789578812.797262:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277041024:0@lo:101: 00010000:00010000:0.0:1789578812.797344:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.797372:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578812.797445:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277041152:0@lo:501: 00000100:00100000:0.0:1789578812.797481:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.797499:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036593cca going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.797513:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041152 00000100:00100000:0.0:1789578812.797516:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041152 00000100:00100000:0.0:1789578812.797536:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789578812.797542:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051408150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277041152:12345-0@lo:501: 00000100:00100000:0.0:1789578812.797614:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051408150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277041152:12345-0@lo:501: Request processed in 71us (133us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789578812.797637:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789578812.797668:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277041152:0@lo:501: 10000000:01000000:0.0:1789578812.797695:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789578812.797701:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578812.797709:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: 00000000cfaa1899/0xd90373d592f20a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789578812.805894:0:6495:0:(import.c:65:import_set_state_nolock()) 000000003dc8b244 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578812.806004:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ece6081 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277040640:12345-0@lo:38: Request processed in 17963us (18112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.806019:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578812.806194:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789578812.806204:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789578812.806213:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789578812.806225:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789578812.806227:0:3614:0:(import.c:65:import_set_state_nolock()) 00000000ea4f71fb lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789578812.806249:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000094809f06): req@00000000d8ed4b88 x1876509277040768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578812.806265:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d9d010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277040640:0@lo:38: 00000100:00100000:0.0:1789578812.806513:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277041280:0@lo:41: 00000100:00100000:0.0:1789578812.806557:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.806605:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041280 00000100:00100000:0.0:1789578812.806611:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041280 00000100:00100000:0.0:1789578812.806645:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789578812.806652:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000054c2094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277041280:12345-0@lo:41: 00000004:00000024:0.0:1789578812.807232:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789578812.807279:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000054c2094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277041280:12345-0@lo:41: Request processed in 627us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.807286:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789578812.807329:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f8862df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277041280:0@lo:41: 00000100:00100000:0.0:1789578812.807400:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.807424:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277040768 00000100:00100000:0.0:1789578812.807436:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277040768 00000100:00100000:0.0:1789578812.807459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789578812.807465:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f8862df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277040768:12345-0@lo:1000: 00000100:00100000:0.0:1789578812.807521:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f8862df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277040768:12345-0@lo:1000: Request processed in 56us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578812.807526:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789578812.807555:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277040768:0@lo:1000: 00000040:01000000:0.0:1789578812.807584:0:7727:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789578812.807621:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041408:0@lo:1000: 00000100:00100000:0.0:1789578812.807648:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578812.810246:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041408 00000100:00100000:2.0:1789578812.810262:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041408 00000100:00100000:2.0:1789578812.810323:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789578812.810332:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000260e5ccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041408:12345-0@lo:1000: 00000100:00100000:2.0:1789578812.810514:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000260e5ccd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041408:12345-0@lo:1000: Request processed in 183us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.810521:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578812.811857:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb62c3ce going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.811896:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041408:0@lo:1000: 00000100:00100000:0.0:1789578812.811970:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041536:0@lo:700: 00000100:00100000:0.0:1789578812.812016:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.812111:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb62c3ce going to sleep for 11 seconds 00000100:00100000:3.0:1789578812.814081:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041536 00000100:00100000:3.0:1789578812.814095:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041536 00000100:00100000:3.0:1789578812.814684:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789578812.814694:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060f04339 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041536:12345-0@lo:700: 00000100:00100000:3.0:1789578812.814794:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060f04339 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041536:12345-0@lo:700: Request processed in 102us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578812.814801:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789578812.818366:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041536:0@lo:700: 00000100:00100000:0.0:1789578812.818579:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041664:0@lo:1000: 00000100:00100000:0.0:1789578812.818637:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.818687:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000703e96af going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.819017:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041664 00000100:00100000:2.0:1789578812.819025:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041664 00000100:00100000:2.0:1789578812.819118:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789578812.819135:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a002642 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041664:12345-0@lo:1000: 00000100:00100000:2.0:1789578812.819240:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a002642 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041664:12345-0@lo:1000: Request processed in 116us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.819254:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789578812.820468:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041664:0@lo:1000: 00000004:00080000:3.0:1789578812.820536:0:7727:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000bb62c3ce with version 0 00000020:00100000:3.0:1789578812.820560:0:7727:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789578812.820566:0:7727:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001ede1fa5 x1876509277041920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789578812.820584:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ede1fa5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041920:0@lo:1000: 00000100:00100000:3.0:1789578812.820631:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578812.821624:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 000000004458c378 going to sleep for 11 seconds 00000100:00100000:0.0:1789578812.821825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277041920 00000100:00100000:0.0:1789578812.821836:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277041920 00000100:00100000:0.0:1789578812.821878:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789578812.821885:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e870208d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7727:x1876509277041920:12345-0@lo:1000: 00000001:00080000:0.0:1789578812.827816:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789578812.827834:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789578812.827960:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e870208d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7727:x1876509277041920:12345-0@lo:1000: Request processed in 6073us (7326us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789578812.827980:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789578812.828035:0:7727:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789578812.828040:0:7727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789578812.828056:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ede1fa5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277041920:0@lo:1000: 00000100:00100000:0.0:1789578812.828154:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277042048:0@lo:1000: 00000100:00100000:0.0:1789578812.828189:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578812.828223:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9a92717 going to sleep for 11 seconds 00000100:00100000:2.0:1789578812.828547:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042048 00000100:00100000:2.0:1789578812.828555:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042048 00000100:00100000:2.0:1789578812.828595:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789578812.828602:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043c5cee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7727:x1876509277042048:12345-0@lo:1000: 00000100:00100000:2.0:1789578812.833087:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043c5cee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7727:x1876509277042048:12345-0@lo:1000: Request processed in 4476us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578812.833101:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578812.833619:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ffc98974 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7727:1876509277042048:0@lo:1000: 00000040:00080000:0.0:1789578812.833656:0:7727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789578812.833709:0:7727:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000fcdd32d5 with version 1 00000004:00080000:2.0:1789578812.835786:0:7725:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e123bfb0 version 1 rpc_version 1 00000020:00100000:2.0:1789578812.835832:0:7725:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789578812.835840:0:7725:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003827ec91 x1876509277042304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789578812.835862:0:7725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003827ec91 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7725:1876509277042304:0@lo:1000: 00000100:00100000:2.0:1789578812.835931:0:7725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578812.835975:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042304 00000100:00100000:2.0:1789578812.835983:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042304 00000100:00100000:2.0:1789578812.836025:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789578812.836033:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037f5db43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7725:x1876509277042304:12345-0@lo:1000: 00000100:00100000:2.0:1789578812.836212:0:7725:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f8212c8 going to sleep for 11 seconds 00000040:00080000:0.0:1789578812.837599:0:7727:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789578812.837886:0:7727:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789578812.837892:0:7727:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789578812.845222:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789578812.845448:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037f5db43 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7725:x1876509277042304:12345-0@lo:1000: Request processed in 9413us (9513us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789578812.845461:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1789578812.845579:0:7725:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789578812.845585:0:7725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789578812.845603:0:7725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003827ec91 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7725:1876509277042304:0@lo:1000: 00000020:00000004:1.0:1789578812.950173:0:7747:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789578812.950507:0:7747:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789578813.544617:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578814.563743:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578815.593204:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789578815.758620:0:7848:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578815.758804:0:7848:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789578816.613343:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789578816.867573:0:7896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe2907dc0 20000000:00000080:3.0:1789578816.867591:0:7896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9394372cd800 uarg=0000000000000000 20000000:01000000:3.0:1789578816.867630:0:7896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789578816.867637:0:7896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789578816.867647:0:7896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789578816.869547:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789578816.869569:0:7896:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789578816.878039:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578816.878308:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789578816.878342:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789578816.878605:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789578816.879000:0:7896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789578816.879020:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879039:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f208a5 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879046:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20993 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879053:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879089:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879115:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 17 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578816.879128:0:7896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3da7acd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1876509277042432:0@lo:104: 00000100:00100000:3.0:1789578816.879186:0:7896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578816.879248:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.879255:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 17 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578816.879270:0:7896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf441922 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1876509277042560:0@lo:104: 00000100:00100000:3.0:1789578816.879288:0:7896:0:(client.c:2716:ptlrpc_set_wait()) set 00000000caae517d going to sleep for 11 seconds 00000100:00100000:1.0:1789578816.879393:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789578816.879412:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578816.879434:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042432 00000100:00100000:1.0:1789578816.879441:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042432 00000100:00100000:1.0:1789578816.879472:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042560 00000100:00100000:1.0:1789578816.879474:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042560 00000100:00100000:1.0:1789578816.879485:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789578816.879497:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d04c5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:7896:x1876509277042432:12345-0@lo:104: 00010000:00010000:1.0:1789578816.879509:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879561:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578816.879565:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d04c5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:7896:x1876509277042432:12345-0@lo:104: Request processed in 69us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578816.879572:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789578816.879606:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789578816.879611:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059c7b9eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:7896:x1876509277042560:12345-0@lo:104: 00010000:00010000:1.0:1789578816.879617:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879655:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789578816.879659:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059c7b9eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:7896:x1876509277042560:12345-0@lo:104: Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578816.879664:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789578816.879678:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789578816.879683:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879690:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009175fcf already unused, calling callback (00000000e50f8cad) 10000000:00010000:1.0:1789578816.879693:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879700:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578816.879722:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578816.879735:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789578816.879763:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879769:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578816.879783:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879797:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 0000000009175fcf/0xd90373d592f20993 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f2099a expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879812:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789578816.879814:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879819:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d48ea08 already unused, calling callback (00000000e50f8cad) 10000000:00010000:1.0:1789578816.879821:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879826:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578816.879831:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578816.879836:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789578816.879848:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879853:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578816.879864:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879870:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: 000000007d48ea08/0xd90373d592f208a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f208ac expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578816.879882:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578816.879884:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578816.879885:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578816.879891:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578816.880258:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e87cb4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277042688:0@lo:103: 00000100:00100000:0.0:1789578816.880296:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578816.880337:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578816.880342:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277042816:0@lo:103: 00000100:00100000:0.0:1789578816.880398:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578816.880428:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042688 00000100:00100000:0.0:1789578816.880433:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042688 00010000:00010000:0.0:1789578816.880454:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 18 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578816.880489:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042816 00000100:00100000:0.0:1789578816.880492:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042816 00010000:00010000:0.0:1789578816.880504:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 19 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578816.880516:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789578816.880521:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc98974 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3615:x1876509277042688:12345-0@lo:103: 00010000:00010000:0.0:1789578816.880530:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578816.880534:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 19 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880543:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 19 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880557:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578816.880580:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc98974 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3615:x1876509277042688:12345-0@lo:103: Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578816.880586:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789578816.880598:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789578816.880602:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c464e5b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3615:x1876509277042816:12345-0@lo:103: 00010000:00010000:0.0:1789578816.880608:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578816.880611:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 18 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880618:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 18 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880639:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880651:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880664:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880670:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880675:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880681:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880686:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098f6463f already unused, calling callback (00000000151b4d03) 00010000:00010000:0.0:1789578816.880689:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880695:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880702:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578816.880728:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578816.880751:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c464e5b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3615:x1876509277042816:12345-0@lo:103: Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578816.880758:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789578816.881062:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1b2394 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277042816:0@lo:103: 00000100:00100000:0.0:1789578816.881083:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e87cb4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277042688:0@lo:103: 00010000:00010000:3.0:1789578816.881245:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000e8e973/0xd90373d592f2099a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20993 expref: 17 pid: 6482 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578816.881259:0:7896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3da7acd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1876509277042432:0@lo:104: 00010000:00010000:3.0:1789578816.881269:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000757765e/0xd90373d592f208ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f208a5 expref: 16 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578816.881276:0:7896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf441922 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1876509277042560:0@lo:104: 00010000:00010000:3.0:1789578816.881293:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.881301:0:7896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.881306:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578816.881311:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098f6463f/0xd90373d592f20a2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578817.641641:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578817.891780:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578817.891957:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277042944:0@lo:41: 00000100:00100000:0.0:1789578817.892021:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578817.892200:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038776cf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277043072:0@lo:400: 00000100:00100000:0.0:1789578817.892234:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578817.892258:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d9d010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277043584:0@lo:400: 00000100:00100000:0.0:1789578817.892303:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578817.892342:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043072 00000100:00100000:3.0:1789578817.892386:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043072 00000100:00100000:3.0:1789578817.892445:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789578817.892453:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b28583fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3618:x1876509277043072:12345-0@lo:400: 00000100:00100000:3.0:1789578817.892500:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b28583fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3618:x1876509277043072:12345-0@lo:400: Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578817.892516:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789578817.892861:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277042944 00000100:00100000:2.0:1789578817.892866:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277042944 00000100:00100000:0.0:1789578817.892903:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038776cf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277043072:0@lo:400: 00000100:00100000:0.0:1789578817.892918:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578817.892926:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003827ec91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277043456:0@lo:400: 00000100:00100000:0.0:1789578817.892954:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578817.892983:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8f7d91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277043200:0@lo:400: 00000100:00100000:0.0:1789578817.893005:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578817.893023:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf441922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277043712:0@lo:41: 00000100:00100000:0.0:1789578817.893045:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578817.893117:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578817.893123:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001dab8f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277043328:0@lo:400: 00000100:00100000:0.0:1789578817.893145:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578817.893161:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043584 00000100:00100000:3.0:1789578817.893165:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043584 00000100:00100000:3.0:1789578817.893183:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043712 00000100:00100000:3.0:1789578817.893186:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043712 00000100:00100000:3.0:1789578817.893199:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789578817.893205:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007e965eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277042944:12345-0@lo:41: 00000004:00000024:3.0:1789578817.893236:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789578817.893276:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007e965eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277042944:12345-0@lo:41: Request processed in 72us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578817.893283:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789578817.893296:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789578817.893302:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000576c2544 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277043584:12345-0@lo:400: 00000100:00100000:3.0:1789578817.893329:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000576c2544 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277043584:12345-0@lo:400: Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578817.893335:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789578817.893346:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789578817.893919:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001483b669 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277043712:12345-0@lo:41: 00000004:00000024:3.0:1789578817.893943:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789578817.893979:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001483b669 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277043712:12345-0@lo:41: Request processed in 608us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578817.893985:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789578817.894028:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d9d010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277043584:0@lo:400: 00000100:00100000:3.0:1789578817.894043:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8ed4b88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277042944:0@lo:41: 00000100:00100000:0.0:1789578817.895875:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf441922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277043712:0@lo:41: 00000100:00100000:0.0:1789578817.895919:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043456 00000100:00100000:0.0:1789578817.895925:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043456 00000100:00100000:0.0:1789578817.895973:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043200 00000100:00100000:0.0:1789578817.895977:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043200 00000100:00100000:0.0:1789578817.896014:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789578817.896020:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000813bb83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277043456:12345-0@lo:400: 00000100:00100000:0.0:1789578817.896103:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000813bb83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277043456:12345-0@lo:400: Request processed in 83us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578817.896110:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789578817.896126:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789578817.896132:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d33278 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277043200:12345-0@lo:400: 00000100:00100000:0.0:1789578817.896167:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d33278 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277043200:12345-0@lo:400: Request processed in 36us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578817.896173:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789578817.896204:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a8f7d91f x1876509277043200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578817.896216:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8f7d91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277043200:0@lo:400: 00010000:00080000:2.0:1789578817.896390:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003827ec91 x1876509277043456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578817.896408:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003827ec91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277043456:0@lo:400: 00000100:00100000:3.0:1789578817.896674:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043328 00000100:00100000:3.0:1789578817.896687:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043328 00000100:00100000:3.0:1789578817.896763:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789578817.896770:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018bcfe03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277043328:12345-0@lo:400: 00000100:00100000:3.0:1789578817.896829:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018bcfe03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277043328:12345-0@lo:400: Request processed in 60us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578817.896835:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578817.896893:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001dab8f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277043328:0@lo:400: 00010000:00010000:2.0:1789578818.660027:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578819.690953:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578820.708171:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578821.732471:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789578822.503155:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789578822.503230:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f42d800 from 1 10000000:01000000:1.0:1789578822.503235:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789578822.503275:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503287:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503297:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578822.503318:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277043840:0@lo:101: 00000100:00100000:1.0:1789578822.503407:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.503457:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feef7bc6 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.503480:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043840 00000100:00100000:1.0:1789578822.503487:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043840 00000100:00100000:1.0:1789578822.503666:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578822.503677:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b08b2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277043840:12345-0@lo:101: 00010000:00010000:1.0:1789578822.503690:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578822.503703:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c4b2ea4/0xd90373d592f20a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a34 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503731:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c4b2ea4/0xd90373d592f20a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a34 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503741:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c4b2ea4/0xd90373d592f20a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a34 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503750:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c4b2ea4, rc 0) 00000100:00100000:1.0:1789578822.503792:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b08b2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277043840:12345-0@lo:101: Request processed in 117us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.503798:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578822.503849:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277043840:0@lo:101: 00010000:00010000:1.0:1789578822.503863:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20a34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.503871:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: 00000000473d36d4/0xd90373d592f20a34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578822.503926:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277043968:0@lo:501: 00000100:00100000:1.0:1789578822.503956:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.503974:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feef7bc6 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.503989:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277043968 00000100:00100000:1.0:1789578822.503992:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277043968 00000100:00100000:1.0:1789578822.504012:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578822.504017:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a29694d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277043968:12345-0@lo:501: 00000100:00100000:1.0:1789578822.504139:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a29694d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277043968:12345-0@lo:501: Request processed in 122us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.504146:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578822.504247:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277043968:0@lo:501: 00000100:00100000:1.0:1789578822.504271:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044096:0@lo:503: 00000100:00100000:1.0:1789578822.504304:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.504317:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000feef7bc6 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.504329:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044096 00000100:00100000:1.0:1789578822.504332:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044096 00000100:00100000:1.0:1789578822.504375:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789578822.504380:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008314d5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277044096:12345-0@lo:503: 00000100:00100000:1.0:1789578822.504600:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008314d5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277044096:12345-0@lo:503: Request processed in 219us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.504608:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789578822.504657:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1799b11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044096:0@lo:503: 00000100:00100000:1.0:1789578822.509634:0:8196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040cbf7cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8196:1876509277044224:0@lo:502: 00000100:00100000:1.0:1789578822.509708:0:8196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.509757:0:8196:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f203984 going to sleep for 11 seconds 00000100:00100000:2.0:1789578822.509855:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044224 00000100:00100000:2.0:1789578822.509862:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044224 00000100:00100000:2.0:1789578822.509909:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789578822.509917:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f9dc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8196:x1876509277044224:12345-0@lo:502: 00000100:00100000:2.0:1789578822.510030:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f9dc2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8196:x1876509277044224:12345-0@lo:502: Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578822.510038:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789578822.510202:0:8196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040cbf7cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8196:1876509277044224:0@lo:502: 00000020:01000000:1.0:1789578822.510230:0:8196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578822.510240:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578822.510242:0:8196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789578822.510249:0:8196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940f42d800 00000020:00000080:1.0:1789578822.510251:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789578822.510290:0:8196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8196:1876509277044352:0@lo:502: 00000100:00100000:1.0:1789578822.510334:0:8196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.510541:0:8196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789578822.510711:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044352 00000100:00100000:2.0:1789578822.510716:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044352 00000100:00100000:2.0:1789578822.510775:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789578822.510783:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8196:x1876509277044352:12345-0@lo:502: 00000100:00100000:2.0:1789578822.510857:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8196:x1876509277044352:12345-0@lo:502: Request processed in 74us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578822.510864:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789578822.513778:0:8196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8196:1876509277044352:0@lo:502: 00000020:01000000:1.0:1789578822.513822:0:8196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578822.513833:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578822.513841:0:8196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789578822.513845:0:8196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789578822.513925:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789578822.513944:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789578822.513953:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.513964:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578822.513975:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789578822.513977:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940679b000 from 1 10000000:01000000:1.0:1789578822.513980:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789578822.514013:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514021:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514031:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578822.514049:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044480:0@lo:101: 00000100:00100000:1.0:1789578822.514113:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.514148:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410cabd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.514180:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044480 00000100:00100000:1.0:1789578822.514187:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044480 00000100:00100000:1.0:1789578822.514223:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789578822.514231:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277044480:12345-0@lo:101: 00010000:00010000:1.0:1789578822.514243:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578822.514257:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a42 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514286:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a42 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514296:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a42 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514447:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6000, rc 0) 00000100:00100000:1.0:1789578822.514483:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277044480:12345-0@lo:101: Request processed in 252us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.514489:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789578822.514544:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044480:0@lo:101: 00010000:00010000:1.0:1789578822.514560:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.514568:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578822.514741:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044608:0@lo:501: 00000100:00100000:1.0:1789578822.514767:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.514793:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.514808:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044608 00000100:00100000:1.0:1789578822.514813:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044608 00000100:00100000:1.0:1789578822.514841:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789578822.514850:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277044608:12345-0@lo:501: 00000100:00100000:1.0:1789578822.514965:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277044608:12345-0@lo:501: Request processed in 117us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.514973:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789578822.515022:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044608:0@lo:501: 00000100:00100000:1.0:1789578822.515050:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044736:0@lo:503: 00000100:00100000:1.0:1789578822.518806:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578822.518858:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044736 00000100:00100000:1.0:1789578822.518867:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044736 00000100:00100000:1.0:1789578822.518912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789578822.518921:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277044736:12345-0@lo:503: 00000100:00100000:1.0:1789578822.519032:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277044736:12345-0@lo:503: Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.519040:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789578822.519099:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.519121:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277044736:0@lo:503: 00000100:00100000:3.0:1789578822.522312:0:8197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8197:1876509277044864:0@lo:502: 00000100:00100000:3.0:1789578822.522404:0:8197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578822.522445:0:8197:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436298d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.523113:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044864 00000100:00100000:1.0:1789578822.523122:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044864 00000100:00100000:1.0:1789578822.523169:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789578822.523178:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8197:x1876509277044864:12345-0@lo:502: 00000100:00100000:1.0:1789578822.523310:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8197:x1876509277044864:12345-0@lo:502: Request processed in 132us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.523317:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578822.523535:0:8197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8197:1876509277044864:0@lo:502: 00000020:01000000:3.0:1789578822.523565:0:8197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578822.523575:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578822.523577:0:8197:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789578822.523703:0:8197:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940679b000 00000020:00000080:3.0:1789578822.523707:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578822.523735:0:8197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8197:1876509277044992:0@lo:502: 00000100:00100000:3.0:1789578822.523772:0:8197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578822.523796:0:8197:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940305aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578822.523855:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277044992 00000100:00100000:1.0:1789578822.523861:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277044992 00000100:00100000:1.0:1789578822.523886:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789578822.523892:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8197:x1876509277044992:12345-0@lo:502: 00000100:00100000:1.0:1789578822.523968:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8197:x1876509277044992:12345-0@lo:502: Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578822.523975:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578822.524945:0:8197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8197:1876509277044992:0@lo:502: 00000020:01000000:3.0:1789578822.524978:0:8197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578822.524985:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578822.524987:0:8197:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789578822.524992:0:8197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789578822.525330:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789578822.525378:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789578822.525390:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578822.525401:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578822.760078:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578823.011671:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578823.011707:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277045120:0@lo:41: 00000100:00100000:0.0:1789578823.011809:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578823.011951:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045120 00000100:00100000:2.0:1789578823.011962:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045120 00000100:00100000:2.0:1789578823.012039:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789578823.012058:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277045120:12345-0@lo:41: 00000004:00000024:2.0:1789578823.012108:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789578823.012175:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277045120:12345-0@lo:41: Request processed in 127us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578823.012203:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789578823.012262:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277045120:0@lo:41: 00000100:00100000:3.0:1789578823.013079:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277045248:0@lo:400: 00000100:00100000:3.0:1789578823.013132:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578823.013167:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578823.013173:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277045376:0@lo:400: 00000100:00100000:3.0:1789578823.013214:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578823.013250:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045248 00000100:00100000:3.0:1789578823.013256:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045248 00000100:00100000:3.0:1789578823.013298:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789578823.013305:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3617:x1876509277045248:12345-0@lo:400: 00000100:00100000:3.0:1789578823.013345:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3617:x1876509277045248:12345-0@lo:400: Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578823.013371:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789578823.013403:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045376 00000100:00100000:3.0:1789578823.013407:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045376 00000100:00100000:3.0:1789578823.013437:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578823.013444:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277045376:12345-0@lo:400: 00000100:00100000:3.0:1789578823.013476:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277045376:12345-0@lo:400: Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578823.013482:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578823.013508:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277045632:0@lo:400: 00000100:00100000:3.0:1789578823.013534:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578823.013555:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578823.013561:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277045504:0@lo:400: 00000100:00100000:3.0:1789578823.013603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578823.013631:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045504 00000100:00100000:3.0:1789578823.013636:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045504 00000100:00100000:3.0:1789578823.013670:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578823.013676:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277045504:12345-0@lo:400: 00000100:00100000:3.0:1789578823.013713:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277045504:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578823.013719:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789578823.013772:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9394362d0000 x1876509277045376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578823.013785:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277045376:0@lo:400: 00000100:00100000:3.0:1789578823.013795:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277045248:0@lo:400: 00010000:00080000:3.0:1789578823.013831:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9394362d2d80 x1876509277045504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578823.013841:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277045504:0@lo:400: 00000100:00100000:3.0:1789578823.013858:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045632 00000100:00100000:3.0:1789578823.013861:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045632 00000100:00100000:3.0:1789578823.013886:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789578823.013893:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277045632:12345-0@lo:400: 00000100:00100000:3.0:1789578823.013929:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277045632:12345-0@lo:400: Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578823.013935:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789578823.013962:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277045632:0@lo:400: 00000100:00100000:0.0:1789578823.021078:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578823.021114:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277045760:0@lo:41: 00000100:00100000:0.0:1789578823.021204:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578823.021261:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045760 00000100:00100000:0.0:1789578823.021272:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045760 00000100:00100000:0.0:1789578823.021328:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789578823.021338:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277045760:12345-0@lo:41: 00000004:00000024:0.0:1789578823.024639:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789578823.025563:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277045760:12345-0@lo:41: Request processed in 3406us (3540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578823.025578:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789578823.025683:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277045760:0@lo:41: 00010000:00010000:0.0:1789578823.781704:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578824.803621:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578825.827546:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789578826.650566:0:8396:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789578826.650572:0:8396:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789578826.650573:0:8396:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789578826.650733:0:8396:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93943711c800 00000020:01000004:0.0:1789578826.650753:0:8396:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789578826.650768:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789578826.650785:0:8396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9394071a3380) 00000020:00000080:0.0:1789578826.650803:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789578826.704423:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789578826.704511:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789578826.735478:0:8396:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789578826.735773:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789578826.735790:0:8396:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789578826.735808:0:8396:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f20a57 00000020:01000004:3.0:1789578826.735818:0:8396:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789578826.735848:0:8396:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789578826.735853:0:8396:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789578826.735860:0:8396:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789578826.735867:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789578826.735881:0:8396:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff939410088000) 00000020:00000080:3.0:1789578826.735906:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789578826.743639:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578826.743888:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789578826.743896:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789578826.746035:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789578826.746049:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789578826.746467:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789578826.746474:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789578826.747990:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578826.748218:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789578826.748226:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789578826.750837:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789578826.750855:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789578826.787689:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578826.788184:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789578826.788192:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789578826.790901:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789578826.790918:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789578826.792508:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789578826.792527:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789578826.795527:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789578826.795865:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789578826.795883:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789578826.799433:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789578826.799454:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1789578826.852195:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578826.886977:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789578826.887544:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789578826.887561:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789578826.891481:0:8396:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789578826.891802:0:8396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789578826.896251:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789578826.896296:0:8396:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789578826.896302:0:8396:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789578826.942327:0:8396:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789578826.942546:0:8396:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789578826.942551:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789578826.942553:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789578826.942554:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578826.942556:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578826.942557:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578826.942559:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578826.942560:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578826.942562:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578826.942563:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578826.942565:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578826.942566:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789578826.942570:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789578826.942572:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789578826.942573:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789578826.942575:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578826.942575:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578826.942576:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578826.942578:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578826.942578:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578826.942579:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578826.942580:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578826.942581:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578826.942582:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789578826.944043:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789578826.944071:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277045888:0@lo:253: 00000100:00100000:3.0:1789578826.944161:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.944265:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578826.949152:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277045888 00000100:00100000:1.0:1789578826.949166:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277045888 00000100:00100000:0.0:1789578826.951825:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789578826.951839:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8396:x1876509277045888:12345-0@lo:253: 20000000:01000000:0.0:1789578826.951884:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789578826.951889:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789578826.951895:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789578826.951898:0:6485:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789578826.952212:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789578826.952442:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789578826.952457:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789578826.952483:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789578826.952493:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789578826.952534:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789578826.952552:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789578826.952642:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789578826.952657:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789578826.952658:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789578826.952673:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789578826.952679:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789578826.952691:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789578826.952697:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789578826.952710:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789578826.952716:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789578826.952728:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789578826.952741:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789578826.952806:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789578826.952816:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789578826.952818:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789578826.952832:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789578826.952837:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789578826.952848:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789578826.952853:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789578826.952864:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789578826.952869:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789578826.952881:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789578826.952896:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789578826.953250:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789578826.953261:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789578826.953263:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789578826.953276:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789578826.953282:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789578826.953311:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789578826.953317:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789578826.953330:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789578826.953336:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789578826.953347:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789578826.953402:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789578826.953416:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789578826.953419:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789578826.953422:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789578826.953463:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789578826.953466:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789578826.957560:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789578826.957618:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789578826.957637:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789578826.958053:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789578826.958078:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789578826.958092:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789578826.958103:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789578826.958106:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789578826.962852:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789578826.963213:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789578826.963244:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789578826.963260:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789578826.963271:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789578826.963273:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789578826.963853:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789578826.963884:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789578826.963900:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789578826.964134:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789578826.964157:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789578826.964172:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789578826.964184:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789578826.964186:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789578826.964572:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789578826.964591:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789578826.964618:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789578826.964871:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789578826.964889:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789578826.964903:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1789578826.964928:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789578826.964947:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.964965:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2092a expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.964986:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209a1 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.964994:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209d9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965002:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209f5 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965008:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a1f expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965016:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965065:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965081:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 18 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.965095:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046016:0@lo:104: 00000100:00100000:1.0:1789578826.965155:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578826.965456:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.965465:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 18 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.965473:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046144:0@lo:104: 00000100:00100000:1.0:1789578826.965502:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578826.969877:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.969895:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 18 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.969908:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046272:0@lo:104: 00000100:00100000:1.0:1789578826.969973:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578826.971005:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046016 00000100:00100000:0.0:1789578826.971017:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046016 00000100:00100000:0.0:1789578826.971086:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046144 00000100:00100000:0.0:1789578826.971090:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046144 00000100:00100000:0.0:1789578826.971106:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789578826.971115:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6485:x1876509277046016:12345-0@lo:104: 00010000:00010000:0.0:1789578826.971131:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.971308:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789578826.971331:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6485:x1876509277046016:12345-0@lo:104: Request processed in 216us (6175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.971339:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789578826.971383:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789578826.971391:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6485:x1876509277046144:12345-0@lo:104: 00010000:00010000:0.0:1789578826.971399:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.971870:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.971883:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 18 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.971895:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046400:0@lo:104: 00000100:00100000:2.0:1789578826.972006:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789578826.972015:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789578826.972188:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046272 00000100:00100000:2.0:1789578826.972193:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046272 00000100:00100000:2.0:1789578826.972287:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789578826.972295:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6485:x1876509277046272:12345-0@lo:104: 00010000:00010000:2.0:1789578826.972304:0:8419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.972397:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578826.972443:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.972453:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 18 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.972462:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046528:0@lo:104: 00000100:00100000:1.0:1789578826.972484:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578826.972510:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192840 going to sleep for 11 seconds 00000100:00100000:1.0:1789578826.972530:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046016:0@lo:104: 00000100:00100000:1.0:1789578826.972541:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046144:0@lo:104: 00000100:00100000:1.0:1789578826.972547:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046272:0@lo:104: 00010000:00010000:3.0:1789578826.972951:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789578826.972965:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.972973:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578826.972977:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.972985:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578826.972992:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578826.972998:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789578826.973054:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1789578826.973062:0:6473:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:3.0:1789578826.973112:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973119:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578826.973137:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973144:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400031e00/0xd90373d592f20a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a26 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973157:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789578826.973160:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973165:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578826.973175:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973182:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578826.973189:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578826.973194:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578826.973207:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973212:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578826.973226:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973232:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f209f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209fc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973242:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578826.973244:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973252:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578826.973254:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973261:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578826.973277:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578826.973282:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578826.973296:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973301:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578826.973306:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973312:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f209d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209e0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.973321:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578826.973323:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578826.973325:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578826.973338:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277046656:0@lo:103: 00000100:00100000:3.0:1789578826.973396:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.973447:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277046784:0@lo:103: 00000100:00100000:3.0:1789578826.973469:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.973485:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578826.973491:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277046912:0@lo:103: 00000100:00100000:3.0:1789578826.973527:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.973553:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046656 00000100:00100000:3.0:1789578826.973558:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046656 00010000:00010000:3.0:1789578826.973581:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 19 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.973608:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046784 00000100:00100000:3.0:1789578826.973611:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046784 00010000:00010000:3.0:1789578826.973624:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 20 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.973635:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046912 00000100:00100000:3.0:1789578826.973637:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046912 00010000:00010000:3.0:1789578826.973647:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 21 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.973658:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578826.973665:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3618:x1876509277046656:12345-0@lo:103: 00010000:00010000:3.0:1789578826.973676:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578826.973681:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974177:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974191:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519200/0xd90373d592f20a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20a1f expref: 21 pid: 6485 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974206:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578826.974251:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3618:x1876509277046656:12345-0@lo:103: Request processed in 585us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.974258:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578826.974279:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578826.974287:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3615:x1876509277046784:12345-0@lo:103: 00010000:00010000:3.0:1789578826.974306:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578826.974311:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 19 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974320:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 19 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974330:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031200/0xd90373d592f209fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f209f5 expref: 19 pid: 6482 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974339:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578826.974391:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3615:x1876509277046784:12345-0@lo:103: Request processed in 105us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.974398:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578826.974410:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789578826.974416:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3615:x1876509277046912:12345-0@lo:103: 00010000:00010000:3.0:1789578826.974424:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578826.974428:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974556:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974569:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af200/0xd90373d592f209e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f209d9 expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.974578:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578826.974602:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3615:x1876509277046912:12345-0@lo:103: Request processed in 186us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.974616:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789578826.974657:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277046656:0@lo:103: 00000100:00100000:3.0:1789578826.974754:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277046912:0@lo:103: 00000100:00100000:3.0:1789578826.974765:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277046784:0@lo:103: 00000100:00100000:1.0:1789578826.975150:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046400 00000100:00100000:1.0:1789578826.975157:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046400 00000100:00100000:1.0:1789578826.975184:0:6473:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1789578826.975190:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277046528 00000100:00100000:1.0:1789578826.975193:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277046528 00000100:00100000:3.0:1789578826.975286:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578826.975294:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6485:x1876509277046400:12345-0@lo:104: 00010000:00010000:3.0:1789578826.975306:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975408:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789578826.975413:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+6:6485:x1876509277046400:12345-0@lo:104: Request processed in 122us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.975420:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578826.975513:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789578826.975522:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6485:x1876509277046528:12345-0@lo:104: 00010000:00010000:3.0:1789578826.975530:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975564:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789578826.975570:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6485:x1876509277046528:12345-0@lo:104: Request processed in 50us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.975576:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789578826.975590:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789578826.975596:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975617:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578826.975621:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975629:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578826.975636:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578826.975642:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578826.975669:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975675:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578826.975833:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975841:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f209a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209a8 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975852:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578826.975855:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975860:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578826.975864:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975880:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578826.975887:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578826.975893:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578826.975907:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975982:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578826.975989:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.975996:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c6a00/0xd90373d592f2092a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20931 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976012:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578826.976014:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578826.976016:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578826.976040:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277047040:0@lo:103: 00000100:00100000:3.0:1789578826.976073:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.976109:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578826.976115:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277047168:0@lo:103: 00000100:00100000:3.0:1789578826.976137:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.976162:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047040 00000100:00100000:3.0:1789578826.976166:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047040 00010000:00010000:3.0:1789578826.976186:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.976213:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047168 00000100:00100000:3.0:1789578826.976216:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047168 00010000:00010000:3.0:1789578826.976227:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.976239:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578826.976244:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3617:x1876509277047040:12345-0@lo:103: 00010000:00010000:3.0:1789578826.976254:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578826.976259:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976269:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 17 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976281:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578826.976307:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3617:x1876509277047040:12345-0@lo:103: Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.976312:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578826.976325:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789578826.976331:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3617:x1876509277047168:12345-0@lo:103: 00010000:00010000:3.0:1789578826.976339:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578826.976343:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976375:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976387:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976402:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976415:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976422:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.976429:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.976585:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687400/0xd90373d592f209a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f209a1 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.976597:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046400:0@lo:104: 00010000:00010000:1.0:1789578826.976607:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae200/0xd90373d592f20931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2092a expref: 15 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.976614:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6485:1876509277046528:0@lo:104: 00010000:00010000:0.0:1789578826.976807:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789578826.976815:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6485:x1876509277046144:12345-0@lo:104: Request processed in 5424us (11312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.976823:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789578826.976846:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578826.976880:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.976945:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789578826.976954:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6485:x1876509277046272:12345-0@lo:104: Request processed in 4659us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578826.976960:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789578826.976979:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578826.977078:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578826.977118:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.977128:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.977134:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789578826.977143:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789578826.977587:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277047040:0@lo:103: 00010000:00010000:3.0:1789578826.978787:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789578826.978798:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.978811:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.978828:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.978840:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7c00/0xd90373d592f20a65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.978865:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578826.979175:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:3617:x1876509277047168:12345-0@lo:103: Request processed in 2841us (3033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578826.979185:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578826.979840:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277047168:0@lo:103: 00000100:00100000:1.0:1789578826.980231:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:8396:x1876509277045888:12345-0@lo:253: Request processed in 28393us (36068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578826.980242:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789578826.980652:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277045888:0@lo:253: 10000000:01000000:3.0:1789578826.980749:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789578826.980754:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789578826.980756:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789578826.980757:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578826.980758:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789578826.980759:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578826.980761:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578826.980762:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578826.980764:0:8396:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789578826.980765:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578826.980767:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789578826.980784:0:8396:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93943711c800 from lustre-OST0000 10000000:01000000:3.0:1789578826.980812:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789578826.980815:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789578826.980823:0:8396:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93941008b380 local copy 10000000:01000000:3.0:1789578826.980826:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789578826.980860:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.980872:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.980882:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578826.980900:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047296:0@lo:101: 00000100:00100000:3.0:1789578826.981014:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578826.981101:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578826.981143:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047296 00000100:00100000:1.0:1789578826.981259:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047296 00000100:00100000:1.0:1789578826.981331:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789578826.981341:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:8396:x1876509277047296:12345-0@lo:101: 00010000:00010000:1.0:1789578826.981395:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578826.981411:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7400/0xd90373d592f20a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a6c expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.982117:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7400/0xd90373d592f20a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a6c expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.982136:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7400/0xd90373d592f20a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a6c expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.982154:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:0.0:1789578826.982277:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047296:12345-0@lo:101: Request processed in 937us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.982285:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789578826.982386:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047296:0@lo:101: 00010000:00010000:1.0:1789578826.982404:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.982413:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.982632:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047424:0@lo:501: 00000100:00100000:1.0:1789578826.982662:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578826.982979:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578826.983120:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047424 00000100:00100000:3.0:1789578826.983126:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047424 00000100:00100000:2.0:1789578826.983242:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789578826.983269:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047424:12345-0@lo:501: 00000100:00100000:2.0:1789578826.983521:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047424:12345-0@lo:501: Request processed in 267us (857us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789578826.983530:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789578826.985260:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047424:0@lo:501: 10000000:01000000:0.0:1789578826.985407:0:8396:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789578826.985652:0:8396:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789578826.985664:0:8396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.985677:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.985775:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.985802:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789578826.985842:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789578826.985847:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93943711c800 00010000:00010000:2.0:1789578826.985855:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578826.985855:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789578826.985866:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789578826.985873:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789578826.985874:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519400 already unused, calling callback (ffffffffc125cc20) 10000000:01000000:0.0:1789578826.985880:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789578826.985885:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 10000000:00010000:2.0:1789578826.985957:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.985971:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578826.985983:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.985988:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.986000:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578826.986011:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578826.986043:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047552:0@lo:101: 10000000:01000000:2.0:1789578826.986087:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578826.986127:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.986133:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789578826.986196:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789578826.986222:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.986231:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20a73 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.986248:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578826.986250:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578826.986252:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578826.986298:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277047680:0@lo:103: 00000100:00100000:1.0:1789578826.986487:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578826.986619:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047680 00000100:00100000:2.0:1789578826.986628:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047680 00000100:00100000:2.0:1789578826.986721:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789578826.986732:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:3616:x1876509277047680:12345-0@lo:103: 00010000:00010000:2.0:1789578826.986748:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789578826.986755:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578826.986766:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7400/0xd90373d592f20a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20a6c expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578826.986787:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578826.986843:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+13:3616:x1876509277047680:12345-0@lo:103: Request processed in 113us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.986851:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394419c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789578826.986852:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578826.987006:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277047680:0@lo:103: 00000100:00100000:3.0:1789578826.987140:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047552 00000100:00100000:3.0:1789578826.987151:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047552 00000100:00100000:3.0:1789578826.987247:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789578826.987269:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+13:8396:x1876509277047552:12345-0@lo:101: 00010000:00010000:3.0:1789578826.987286:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578826.987303:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a7a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.987328:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a7a expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.987340:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a7a expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578826.987377:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519a00, rc 0) 00000100:00100000:3.0:1789578826.987453:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047552:12345-0@lo:101: Request processed in 185us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578826.987460:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789578826.987490:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047552:0@lo:101: 00010000:00010000:1.0:1789578826.987526:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578826.987538:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578826.987755:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047808:0@lo:501: 00000100:00100000:1.0:1789578826.987796:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578826.987882:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047808 00000100:00100000:0.0:1789578826.987890:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047808 00000100:00100000:1.0:1789578826.987892:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578826.988137:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789578826.988158:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047808:12345-0@lo:501: 00000100:00100000:0.0:1789578826.988293:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047808:12345-0@lo:501: Request processed in 148us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.988315:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789578826.988335:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047808:0@lo:501: 00000100:00100000:1.0:1789578826.988427:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047936:0@lo:503: 00000100:00100000:1.0:1789578826.988482:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578826.988506:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192480 going to sleep for 11 seconds 00000100:00100000:2.0:1789578826.988569:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277047936 00000100:00100000:2.0:1789578826.988575:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277047936 00000100:00100000:2.0:1789578826.988678:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789578826.988696:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047936:12345-0@lo:503: 00000100:00100000:2.0:1789578826.989114:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277047936:12345-0@lo:503: Request processed in 419us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578826.989122:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789578826.989212:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277047936:0@lo:503: 00000040:00080000:1.0:1789578826.989687:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789578826.989779:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048064:0@lo:502: 00000100:00100000:1.0:1789578826.989825:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578826.991153:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578826.991675:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048064 00000100:00100000:3.0:1789578826.991689:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048064 00000100:00100000:2.0:1789578826.991821:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789578826.991833:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277048064:12345-0@lo:502: 00000100:00100000:2.0:1789578826.992089:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277048064:12345-0@lo:502: Request processed in 257us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578826.992099:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789578826.992343:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048064:0@lo:502: 00000040:00080000:1.0:1789578826.992744:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789578826.992782:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789578826.992796:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789578826.992809:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789578826.992821:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789578826.992832:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789578826.992872:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048192:0@lo:502: 00000100:00100000:1.0:1789578826.992950:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578826.993001:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1789578826.993393:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048192 00000100:00100000:0.0:1789578826.993402:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048192 00000100:00100000:0.0:1789578826.993456:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789578826.993466:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277048192:12345-0@lo:502: 00000100:00100000:0.0:1789578826.993595:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277048192:12345-0@lo:502: Request processed in 130us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578826.993601:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789578826.993724:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048192:0@lo:502: 00000040:00080000:3.0:1789578826.993795:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789578826.993807:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789578826.994676:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789578826.994690:0:8421:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789578826.994700:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578826.994703:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789578826.994709:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789578826.994743:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9393020d8000) 00000020:00000080:3.0:1789578826.994769:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789578826.994776:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789578826.994858:0:8421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943711c800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789578826.994867:0:8421:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789578826.995091:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f20a8f 00010000:00010000:2.0:1789578827.001504:0:8421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789578827.001875:0:8421:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789578827.011264:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789578827.013264:0:8421:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789578827.025966:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789578827.026239:0:8421:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789578827.038156:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789578827.041677:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789578827.041693:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578827.041701:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578827.041703:0:8421:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789578827.041707:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578827.041711:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578827.041712:0:8421:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789578827.041716:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789578827.041718:0:8421:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789578827.041751:0:8421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578827.041754:0:8421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578827.041755:0:8421:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789578827.041758:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789578827.041952:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789578827.041987:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789578827.042030:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.042043:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578827.042053:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943711c800 from 1 10000000:01000000:1.0:1789578827.042056:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789578827.042108:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.042117:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.042142:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578827.042175:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048320:0@lo:101: 00000100:00100000:1.0:1789578827.042263:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.042323:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1789578827.042691:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048320 00000100:00100000:0.0:1789578827.042703:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048320 00000100:00100000:0.0:1789578827.042757:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789578827.042769:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:8396:x1876509277048320:12345-0@lo:101: 00010000:00010000:0.0:1789578827.042787:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578827.042805:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20a96 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.042836:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20a96 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.042864:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a96 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.042874:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031e00, rc 0) 00000100:00100000:0.0:1789578827.043853:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048320:12345-0@lo:101: Request processed in 1077us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578827.043863:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789578827.044439:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048320:0@lo:101: 00010000:00010000:1.0:1789578827.044470:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.044483:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578827.044641:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048448:0@lo:501: 00000100:00100000:1.0:1789578827.044688:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.044732:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.044814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048448 00000100:00100000:3.0:1789578827.044822:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048448 00000100:00100000:3.0:1789578827.044866:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789578827.044876:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048448:12345-0@lo:501: 00000100:00100000:3.0:1789578827.046573:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048448:12345-0@lo:501: Request processed in 1695us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.046586:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789578827.046740:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048448:0@lo:501: 00000100:00100000:1.0:1789578827.046796:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048576:0@lo:503: 00000100:00100000:1.0:1789578827.046859:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578827.046979:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048576 00000100:00100000:3.0:1789578827.046987:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048576 00000100:00100000:1.0:1789578827.047105:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.047298:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789578827.047309:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048576:12345-0@lo:503: 00000100:00100000:3.0:1789578827.047457:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048576:12345-0@lo:503: Request processed in 150us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.047464:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789578827.047560:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048576:0@lo:503: 00000040:00080000:1.0:1789578827.047872:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789578827.048294:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048704:0@lo:502: 00000100:00100000:1.0:1789578827.048389:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.048422:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.048576:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048704 00000100:00100000:3.0:1789578827.048583:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048704 00000100:00100000:3.0:1789578827.048626:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789578827.048635:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048704:12345-0@lo:502: 00000100:00100000:3.0:1789578827.048748:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048704:12345-0@lo:502: Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.048755:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789578827.048864:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048704:0@lo:502: 00000040:00080000:1.0:1789578827.050479:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789578827.050538:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789578827.050589:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048832:0@lo:502: 00000100:00100000:1.0:1789578827.050664:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.050710:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a97540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.051031:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048832 00000100:00100000:3.0:1789578827.051040:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048832 00000100:00100000:3.0:1789578827.051089:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789578827.051106:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048832:12345-0@lo:502: 00000100:00100000:3.0:1789578827.054501:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048832:12345-0@lo:502: Request processed in 3382us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.054519:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789578827.056532:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048832:0@lo:502: 00000040:00080000:1.0:1789578827.056684:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789578827.056704:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789578827.060270:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578827.060287:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578827.060290:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789578827.060311:0:8425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943711c800 00000020:00000080:1.0:1789578827.060315:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789578827.060331:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578827.060334:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578827.060336:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789578827.060339:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789578827.068746:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789578827.068813:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789578827.068842:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.068858:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578827.068945:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789578827.068948:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93943711c800 10000000:01000000:0.0:1789578827.068952:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93943711c800 10000000:01000000:0.0:1789578827.068956:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789578827.068963:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93943711c800 from 1 10000000:01000000:0.0:1789578827.068966:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789578827.069034:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.069043:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.069056:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578827.069108:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048960:0@lo:101: 00000100:00100000:0.0:1789578827.069211:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578827.069268:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394419c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578827.069674:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277048960 00000100:00100000:1.0:1789578827.069685:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277048960 00000100:00100000:1.0:1789578827.069747:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789578827.069759:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8396:x1876509277048960:12345-0@lo:101: 00010000:00010000:1.0:1789578827.069777:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578827.069794:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20aa4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.069824:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.069836:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.069846:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:1.0:1789578827.069921:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277048960:12345-0@lo:101: Request processed in 164us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.069928:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789578827.070046:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277048960:0@lo:101: 00010000:00010000:2.0:1789578827.070067:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.070076:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.070220:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049088:0@lo:501: 00000100:00100000:2.0:1789578827.070248:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578827.070287:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359000 going to sleep for 11 seconds 00000100:00100000:1.0:1789578827.070755:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049088 00000100:00100000:1.0:1789578827.070763:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049088 00000100:00100000:1.0:1789578827.070803:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789578827.070812:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049088:12345-0@lo:501: 00000100:00100000:1.0:1789578827.070971:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049088:12345-0@lo:501: Request processed in 160us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.071010:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789578827.071071:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049088:0@lo:501: 00000100:00100000:1.0:1789578827.071114:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049216:0@lo:503: 00000100:00100000:1.0:1789578827.071171:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.071193:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049216 00000100:00100000:1.0:1789578827.071197:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049216 00000100:00100000:1.0:1789578827.071216:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789578827.071221:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049216:12345-0@lo:503: 00000100:00100000:1.0:1789578827.071296:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049216:12345-0@lo:503: Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.071302:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789578827.071339:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192240 going to sleep for 11 seconds 00000100:00100000:1.0:1789578827.071373:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049216:0@lo:503: 00000040:00080000:1.0:1789578827.071670:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789578827.071749:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049344:0@lo:502: 00000100:00100000:1.0:1789578827.071789:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.071818:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049344 00000100:00100000:1.0:1789578827.071823:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049344 00000100:00100000:1.0:1789578827.071842:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789578827.071848:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049344:12345-0@lo:502: 00000100:00100000:1.0:1789578827.071920:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049344:12345-0@lo:502: Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.071927:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789578827.071957:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789578827.071970:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049344:0@lo:502: 00000040:00080000:1.0:1789578827.072193:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789578827.072222:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789578827.072237:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789578827.072251:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789578827.072265:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789578827.072278:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789578827.072292:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789578827.072307:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789578827.072321:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789578827.072336:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789578827.072376:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789578827.072395:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789578827.072410:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789578827.072424:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789578827.072457:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789578827.072478:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789578827.072497:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789578827.072512:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789578827.072527:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789578827.072542:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789578827.072557:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789578827.072572:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789578827.072587:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789578827.072602:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789578827.072617:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789578827.072632:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789578827.072647:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789578827.072661:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789578827.072675:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789578827.072689:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789578827.072713:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789578827.072729:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789578827.072749:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789578827.072761:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789578827.072773:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789578827.072784:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789578827.072795:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789578827.072824:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049472:0@lo:502: 00000100:00100000:1.0:1789578827.072870:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.072906:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.073933:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049472 00000100:00100000:3.0:1789578827.073947:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049472 00000100:00100000:3.0:1789578827.073999:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789578827.074010:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049472:12345-0@lo:502: 00000100:00100000:3.0:1789578827.074207:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277049472:12345-0@lo:502: Request processed in 198us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.074215:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789578827.074807:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277049472:0@lo:502: 00000040:00080000:1.0:1789578827.076680:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789578827.076715:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789578827.077771:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789578827.077795:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93942e153380) 00000020:00000080:2.0:1789578827.077825:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789578827.077950:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943711c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789578827.077960:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943711c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789578827.077963:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943711c800 3 00010000:00080000:2.0:1789578827.078011:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93942e144800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789578827.083116:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1789578827.083527:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789578827.083608:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789578827.083626:0:8426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd90373d592f20ab9 00000100:00080000:0.0:1789578827.083640:0:8426:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789578827.083655:0:8426:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93942e144800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578827.083704:0:8426:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939437206680 x1876509277049600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789578827.083742:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789578827.084124:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277049728:0@lo:400: 00000100:00100000:1.0:1789578827.084228:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.084281:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789578827.084288:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277050112:0@lo:400: 00000100:00100000:1.0:1789578827.084317:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.084371:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277049856:0@lo:400: 00000100:00100000:1.0:1789578827.084395:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.084414:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578827.084419:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277049984:0@lo:400: 00000100:00100000:1.0:1789578827.084443:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.084482:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049728 00000100:00100000:1.0:1789578827.084490:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049728 00000100:00100000:1.0:1789578827.084539:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049984 00000100:00100000:1.0:1789578827.084542:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049984 00000100:00100000:1.0:1789578827.084559:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789578827.084568:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277049728:12345-0@lo:400: 00000100:00100000:1.0:1789578827.084627:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277049728:12345-0@lo:400: Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.084643:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789578827.084661:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789578827.084667:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277049984:12345-0@lo:400: 00000100:00100000:1.0:1789578827.084701:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277049984:12345-0@lo:400: Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.084706:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789578827.084726:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050112 00000100:00100000:1.0:1789578827.084730:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050112 00000100:00100000:1.0:1789578827.084746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049856 00000100:00100000:1.0:1789578827.084748:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049856 00000100:00100000:1.0:1789578827.084760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789578827.084767:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277050112:12345-0@lo:400: 00000100:00100000:1.0:1789578827.084801:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277050112:12345-0@lo:400: Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.084807:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789578827.084819:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789578827.084825:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277049856:12345-0@lo:400: 00000100:00100000:1.0:1789578827.084853:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277049856:12345-0@lo:400: Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.084859:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789578827.084923:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93940f40f100 x1876509277049984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578827.084939:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277049984:0@lo:400: 00000100:00100000:1.0:1789578827.084951:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277049856:0@lo:400: 00000100:00100000:1.0:1789578827.084981:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277050112:0@lo:400: 00010000:00080000:1.0:1789578827.085002:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93940f40c000 x1876509277049728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578827.085011:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277049728:0@lo:400: 00000100:00100000:3.0:1789578827.085450:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277049600:0@lo:38: 00000100:00100000:3.0:1789578827.085493:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.085918:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277049600 00000100:00100000:1.0:1789578827.085925:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277049600 00000100:00100000:1.0:1789578827.085952:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789578827.085958:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277049600:12345-0@lo:38: 00010000:00080000:1.0:1789578827.085988:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1789578827.086046:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd90373d592f20ac0 00000004:00100000:1.0:1789578827.086065:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789578827.086103:0:6491:0:(import.c:65:import_set_state_nolock()) ffff939302084800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789578827.086169:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876509277049600:12345-0@lo:38: Request processed in 209us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.086176:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789578827.086218:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939437206680 x1876509277049600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578827.086228:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789578827.086235:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789578827.086245:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789578827.086250:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789578827.086253:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789578827.086259:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277049600:0@lo:38: 00000020:01000004:0.0:1789578827.086445:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789578827.086466:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9394071a19c0) 00000020:00000080:0.0:1789578827.086486:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1789578827.086577:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943711c800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789578827.086582:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943711c800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789578827.086584:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943711c800 3 00010000:00080000:0.0:1789578827.086612:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93942f208800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789578827.089100:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789578827.091934:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789578827.092295:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789578827.092316:0:8426:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd90373d592f20ace 00000100:00080000:0.0:1789578827.092330:0:8426:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789578827.092346:0:8426:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93942f208800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578827.092426:0:8426:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939437205180 x1876509277050240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789578827.099137:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789578827.099717:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277050240:0@lo:38: 00000100:00100000:1.0:1789578827.099828:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.099922:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050240 00000100:00100000:1.0:1789578827.099939:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050240 00000100:00100000:1.0:1789578827.099987:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578827.099996:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277050240:12345-0@lo:38: 00010000:00080000:1.0:1789578827.100056:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1789578827.100114:0:6492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd90373d592f20ad5 00000004:00100000:1.0:1789578827.100136:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789578827.100179:0:6492:0:(import.c:65:import_set_state_nolock()) ffff939302083800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789578827.100242:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876509277050240:12345-0@lo:38: Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578827.100251:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789578827.100305:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939437205180 x1876509277050240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578827.100317:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789578827.100326:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789578827.100336:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789578827.100341:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789578827.100344:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942f208800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789578827.100369:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277050240:0@lo:38: 00000040:00080000:0.0:1789578827.103050:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789578827.104154:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789578827.104206:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789578827.104231:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578827.104248:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789578827.104322:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789578827.104328:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789578827.104330:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578827.104331:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789578827.104332:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578827.104333:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578827.104335:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578827.104336:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789578827.104338:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789578827.104339:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578827.104340:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789578827.104345:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789578827.104348:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789578827.105075:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789578827.105076:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578827.105078:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789578827.105079:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578827.105081:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578827.105082:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578827.105083:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789578827.105084:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789578827.105085:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578827.105086:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789578827.105240:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789578827.105266:0:8396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277050368:0@lo:253: 00000100:00100000:1.0:1789578827.107197:0:8396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578827.107333:0:8396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1789578827.115093:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050368 00000100:00100000:2.0:1789578827.115114:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050368 00000100:00100000:2.0:1789578827.115187:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789578827.115198:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277050368:12345-0@lo:253: 20000000:01000000:2.0:1789578827.115240:0:6482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789578827.115259:0:6482:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789578827.124689:0:6482:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789578827.124715:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789578827.125837:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:8396:x1876509277050368:12345-0@lo:253: Request processed in 10631us (18638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578827.125854:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789578827.126615:0:8396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:8396:1876509277050368:0@lo:253: 10000000:01000000:1.0:1789578827.126635:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789578827.126639:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789578827.126641:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789578827.126643:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578827.126644:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789578827.126646:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578827.126647:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578827.126648:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578827.126650:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789578827.126652:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789578827.126653:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578827.126668:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789578827.126887:0:8396:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789578827.128562:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789578827.128574:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789578827.128608:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.128633:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209cb expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.128642:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f209e7 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.128650:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.128705:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.128956:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 15 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578827.128977:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277050496:0@lo:104: 00000100:00100000:0.0:1789578827.129076:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789578827.129135:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578827.129144:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 15 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578827.129170:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277050624:0@lo:104: 00000100:00100000:0.0:1789578827.129192:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394419c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578827.129392:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789578827.130614:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578827.130669:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050496 00000100:00100000:3.0:1789578827.130692:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050496 00000100:00100000:3.0:1789578827.130755:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050624 00000100:00100000:3.0:1789578827.130758:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050624 00000100:00100000:3.0:1789578827.130781:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789578827.130791:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394371e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277050496:12345-0@lo:104: 00010000:00010000:3.0:1789578827.130813:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.130897:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789578827.130904:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394371e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277050496:12345-0@lo:104: Request processed in 115us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.130913:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789578827.131212:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789578827.131221:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277050624:12345-0@lo:104: 00010000:00010000:3.0:1789578827.131230:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.131271:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789578827.131276:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277050624:12345-0@lo:104: Request processed in 57us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.131282:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789578827.137649:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789578827.137669:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.137755:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578827.137761:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.137774:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578827.137781:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578827.137787:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578827.137862:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.137869:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578827.137911:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.137935:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400031400/0xd90373d592f209e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209ee expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.137953:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578827.138649:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.138662:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578827.138665:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.138671:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277050752:0@lo:103: 00010000:00010000:3.0:1789578827.138675:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.138760:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578827.138843:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050752 00000100:00100000:2.0:1789578827.138853:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050752 00010000:00010000:2.0:1789578827.138889:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.138929:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789578827.138939:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3616:x1876509277050752:12345-0@lo:103: 00010000:00010000:2.0:1789578827.138956:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578827.138962:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.138975:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.139009:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1789578827.139042:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578827.139049:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789578827.139058:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3616:x1876509277050752:12345-0@lo:103: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578827.139066:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789578827.139080:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139086:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578827.139103:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139111:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f209cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f209d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139131:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578827.139139:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578827.139141:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578827.139149:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578827.139165:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277050880:0@lo:103: 00000100:00100000:2.0:1789578827.139192:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277050752:0@lo:103: 00000100:00100000:3.0:1789578827.139198:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578827.139233:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277050880 00000100:00100000:3.0:1789578827.139239:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277050880 00010000:00010000:3.0:1789578827.139254:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578827.139287:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789578827.139295:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3617:x1876509277050880:12345-0@lo:103: 00010000:00010000:3.0:1789578827.139302:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578827.139306:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139314:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139328:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.139337:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.140502:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aee00/0xd90373d592f209ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f209e7 expref: 16 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.140522:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277050496:0@lo:104: 00010000:00010000:2.0:1789578827.140537:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363afe00/0xd90373d592f209d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f209cb expref: 15 pid: 6484 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578827.140544:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277050624:0@lo:104: 00010000:00010000:2.0:1789578827.140572:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789578827.140579:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012005865s 00010000:00010000:3.0:1789578827.140586:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140594:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140615:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140623:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140630:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789578827.140634:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140642:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140654:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578827.140664:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789578827.140735:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.140743:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578827.140749:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031c00/0xd90373d592f20adc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578827.140935:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+14:3617:x1876509277050880:12345-0@lo:103: Request processed in 1640us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578827.140945:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789578827.141202:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277050880:0@lo:103: 00080000:10000000:0.0:1789578827.141825:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789578827.142758:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789578827.143035:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789578827.143208:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789578827.144780:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789578827.145087:0:8396:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789578827.150945:0:8396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789578827.165832:0:8396:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789578827.165846:0:8396:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789578827.165892:0:8396:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789578827.165950:0:8396:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789578827.165979:0:8396:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789578827.166005:0:8396:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789578827.175862:0:8396:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578827.177673:0:8396:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789578827.876789:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578828.131589:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277051008:0@lo:41: 00000100:00100000:3.0:1789578828.131658:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578828.131897:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051008 00000100:00100000:0.0:1789578828.131906:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051008 00000100:00100000:0.0:1789578828.131962:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789578828.131972:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277051008:12345-0@lo:41: 00000004:00000024:0.0:1789578828.132008:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789578828.132070:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277051008:12345-0@lo:41: Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578828.132077:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789578828.132123:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277051008:0@lo:41: 00000100:00100000:0.0:1789578828.132931:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578828.132955:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277051136:0@lo:41: 00000100:00100000:0.0:1789578828.133033:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578828.133091:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051136 00000100:00100000:0.0:1789578828.133099:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051136 00000100:00100000:0.0:1789578828.133149:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789578828.133161:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277051136:12345-0@lo:41: 00000004:00000024:0.0:1789578828.133201:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789578828.133257:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277051136:12345-0@lo:41: Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578828.133264:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789578828.133313:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277051136:0@lo:41: 00000020:00000004:2.0:1789578828.341197:0:8483:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578828.341440:0:8483:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789578828.904867:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578829.923919:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578830.950002:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789578831.715438:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578831.715446:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940f42d800 from 30 10000000:01000000:3.0:1789578831.715452:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578831.715503:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.715515:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.715539:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578831.715564:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051264:0@lo:101: 00000100:00100000:3.0:1789578831.715646:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.715699:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.715966:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051264 00000100:00100000:1.0:1789578831.715975:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051264 00000100:00100000:1.0:1789578831.716040:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789578831.716050:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:6487:x1876509277051264:12345-0@lo:101: 00010000:00010000:1.0:1789578831.716063:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578831.716075:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20ae3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.716098:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.716108:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.716117:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:1.0:1789578831.716170:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051264:12345-0@lo:101: Request processed in 122us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.716177:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789578831.716948:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051264:0@lo:101: 00010000:00010000:3.0:1789578831.716971:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.716982:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578831.717065:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051392:0@lo:501: 00000100:00100000:3.0:1789578831.717104:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.717134:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578831.717952:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051392 00000100:00100000:2.0:1789578831.717961:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051392 00000100:00100000:2.0:1789578831.718015:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789578831.718024:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051392:12345-0@lo:501: 00000100:00100000:2.0:1789578831.718170:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051392:12345-0@lo:501: Request processed in 146us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.718177:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789578831.718227:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051392:0@lo:501: 00000100:00100000:2.0:1789578831.718279:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051520:0@lo:503: 00000100:00100000:2.0:1789578831.718324:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578831.718369:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403def540 going to sleep for 11 seconds 00000100:00100000:2.0:1789578831.718384:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051520 00000100:00100000:2.0:1789578831.718395:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051520 00000100:00100000:2.0:1789578831.718417:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578831.718423:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051520:12345-0@lo:503: 00000100:00100000:2.0:1789578831.718500:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051520:12345-0@lo:503: Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.718507:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578831.718547:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051520:0@lo:503: 00000100:00100000:2.0:1789578831.724537:0:8641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8641:1876509277051648:0@lo:502: 00000100:00100000:2.0:1789578831.724718:0:8641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578831.724759:0:8641:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403def600 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.724923:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051648 00000100:00100000:1.0:1789578831.724931:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051648 00000100:00100000:1.0:1789578831.724982:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789578831.725000:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8641:x1876509277051648:12345-0@lo:502: 00000100:00100000:1.0:1789578831.725148:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8641:x1876509277051648:12345-0@lo:502: Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.725156:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789578831.725340:0:8641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8641:1876509277051648:0@lo:502: 00000100:00100000:0.0:1789578831.725563:0:8641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8641:1876509277051776:0@lo:502: 00000100:00100000:0.0:1789578831.725806:0:8641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.725891:0:8641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578831.725998:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051776 00000100:00100000:2.0:1789578831.726004:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051776 00000100:00100000:2.0:1789578831.726037:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789578831.726043:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8641:x1876509277051776:12345-0@lo:502: 00000100:00100000:2.0:1789578831.726139:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:8641:x1876509277051776:12345-0@lo:502: Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.726146:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789578831.726307:0:8641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8641:1876509277051776:0@lo:502: 00000040:00080000:0.0:1789578831.726330:0:8641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789578831.726535:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789578831.726557:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789578831.726572:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.726583:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578831.726722:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789578831.726725:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940f42d800 from 5 10000000:01000000:1.0:1789578831.726729:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789578831.726763:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.726771:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.726782:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578831.726797:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051904:0@lo:101: 00000100:00100000:1.0:1789578831.726901:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.726939:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.727276:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277051904 00000100:00100000:3.0:1789578831.727284:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277051904 00000100:00100000:3.0:1789578831.727408:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789578831.727418:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277051904:12345-0@lo:101: 00010000:00010000:3.0:1789578831.727428:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578831.727443:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20af1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.727464:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.727486:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.727495:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519800, rc 0) 00000100:00100000:3.0:1789578831.727544:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277051904:12345-0@lo:101: Request processed in 128us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.727550:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789578831.728043:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277051904:0@lo:101: 00010000:00010000:1.0:1789578831.728061:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.728070:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578831.728128:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052032:0@lo:256: 00000100:00100000:1.0:1789578831.728171:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.728211:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.728726:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052032 00000100:00100000:3.0:1789578831.728733:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052032 00000100:00100000:3.0:1789578831.728767:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789578831.728775:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277052032:12345-0@lo:256: 20000000:01000000:3.0:1789578831.728804:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789578831.728821:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789578831.728824:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789578831.728926:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277052032:12345-0@lo:256: Request processed in 151us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.728970:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052032:0@lo:256: 10000000:01000000:1.0:1789578831.729025:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789578831.729033:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.729042:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578831.729051:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789578831.729053:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789578831.729056:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789578831.729080:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.729088:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.729097:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578831.729110:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052160:0@lo:101: 00000100:00100000:1.0:1789578831.729138:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.729164:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.729178:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052160 00000100:00100000:1.0:1789578831.729181:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052160 00000100:00100000:3.0:1789578831.744572:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789578831.745181:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789578831.745200:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277052160:12345-0@lo:101: 00010000:00010000:1.0:1789578831.745229:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578831.745247:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20aff expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.745277:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20aff expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.745288:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20aff expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.745298:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401687000, rc 0) 00000100:00100000:1.0:1789578831.746194:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277052160:12345-0@lo:101: Request processed in 998us (17051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.746204:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789578831.746264:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052160:0@lo:101: 00010000:00010000:1.0:1789578831.746285:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.746296:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578831.747063:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052288:0@lo:501: 00000100:00100000:1.0:1789578831.747109:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.747192:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.752140:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052288 00000100:00100000:3.0:1789578831.752156:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052288 00000100:00100000:2.0:1789578831.752404:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789578831.752416:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277052288:12345-0@lo:501: 00000100:00100000:2.0:1789578831.752623:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277052288:12345-0@lo:501: Request processed in 208us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.752632:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789578831.752808:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052288:0@lo:501: 00000100:00100000:1.0:1789578831.752861:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052416:0@lo:503: 00000100:00100000:1.0:1789578831.752929:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.752965:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.753163:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052416 00000100:00100000:3.0:1789578831.753169:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052416 00000100:00100000:3.0:1789578831.753209:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789578831.753216:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277052416:12345-0@lo:503: 00000100:00100000:3.0:1789578831.753326:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277052416:12345-0@lo:503: Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.753333:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789578831.753345:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277052416:0@lo:503: 00000100:00100000:2.0:1789578831.754096:0:8645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8645:1876509277052544:0@lo:502: 00000100:00100000:2.0:1789578831.754144:0:8645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578831.754186:0:8645:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403def3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.754405:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052544 00000100:00100000:1.0:1789578831.754412:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052544 00000100:00100000:1.0:1789578831.754446:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789578831.754453:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8645:x1876509277052544:12345-0@lo:502: 00000100:00100000:1.0:1789578831.754553:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8645:x1876509277052544:12345-0@lo:502: Request processed in 100us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.754561:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789578831.755497:0:8645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8645:1876509277052544:0@lo:502: 00000020:01000000:3.0:1789578831.755536:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789578831.755543:0:8645:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789578831.755551:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578831.755553:0:8645:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789578831.755558:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789578831.755562:0:8645:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789578831.755583:0:8645:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789578831.755586:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789578831.755601:0:8645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9393020db380) 00000020:00000080:3.0:1789578831.755626:0:8645:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789578831.755632:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789578831.755721:0:8645:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789578831.755727:0:8645:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789578831.755734:0:8645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f20b14 00010000:00080000:3.0:1789578831.755770:0:8645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93930232c800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578831.756498:0:8645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789578831.770388:0:8645:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789578831.770412:0:8645:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789578831.770620:0:8645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789578831.770832:0:8645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789578831.770924:0:8645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789578831.771026:0:8645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789578831.774469:0:8648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789578831.774477:0:8648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789578831.783587:0:8645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789578831.785015:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789578831.785081:0:8645:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789578831.785107:0:8645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20b1b 00000100:00080000:1.0:1789578831.785118:0:8645:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789578831.785130:0:8645:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93930232c800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789578831.785287:0:8645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930289ea00 x1876509277052672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789578831.785425:0:8645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789578831.785435:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277052672:0@lo:8: 00000020:01000000:1.0:1789578831.785503:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578831.785507:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578831.785509:0:8645:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789578831.785513:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1789578831.785525:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578831.785617:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052672 00000100:00100000:2.0:1789578831.785626:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052672 00000100:00100000:2.0:1789578831.785664:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789578831.785672:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277052672:12345-0@lo:8: 00010000:00080000:2.0:1789578831.785701:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00100000:0.0:1789578831.785717:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277052800:0@lo:400: 00000020:00000080:2.0:1789578831.785732:0:8403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20b22 00000020:00000080:1.0:1789578831.785743:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578831.785746:0:8645:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789578831.785751:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789578831.785754:0:8645:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789578831.785754:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1789578831.785776:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93942e140000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:0.0:1789578831.785777:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277053312:0@lo:400: 00000100:00100000:1.0:1789578831.785778:0:8645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8645:1876509277053568:0@lo:502: 00002000:00080000:2.0:1789578831.785787:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789578831.785791:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789578831.785810:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.785822:0:8645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.785839:0:8645:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef583c0 going to sleep for 11 seconds 00002000:00100000:2.0:1789578831.785857:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789578831.785912:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578831.785920:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277053184:0@lo:400: 00000100:00100000:0.0:1789578831.785949:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.785998:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277052928:0@lo:400: 00000100:00100000:0.0:1789578831.786027:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.786050:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277053440:0@lo:400: 00000100:00100000:1.0:1789578831.786062:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053184 00000100:00100000:1.0:1789578831.786068:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053184 00000100:00100000:0.0:1789578831.786095:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.786098:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052928 00000100:00100000:1.0:1789578831.786102:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052928 00000100:00100000:0.0:1789578831.786118:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578831.786119:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789578831.786125:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277053056:0@lo:400: 00000100:00100000:1.0:1789578831.786128:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277053184:12345-0@lo:400: 00002000:00080000:2.0:1789578831.786144:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:0.0:1789578831.786152:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789578831.786174:0:8403:0:(import.c:65:import_set_state_nolock()) ffff93942e143000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578831.786181:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277052800 00000100:00100000:0.0:1789578831.786187:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277052800 00000100:00100000:1.0:1789578831.786190:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277053184:12345-0@lo:400: Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.786197:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789578831.786204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053312 00000100:00100000:0.0:1789578831.786207:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053312 00000100:00100000:1.0:1789578831.786209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789578831.786215:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277052928:12345-0@lo:400: 00000100:00100000:1.0:1789578831.786247:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277052928:12345-0@lo:400: Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.786253:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789578831.786326:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053568 00000100:00100000:3.0:1789578831.786331:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053568 00000100:00100000:3.0:1789578831.786384:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578831.786391:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8645:x1876509277053568:12345-0@lo:502: 00000100:00100000:1.0:1789578831.786442:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053440 00000100:00100000:1.0:1789578831.786447:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053440 00000100:00100000:2.0:1789578831.786448:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277052672:12345-0@lo:8: Request processed in 774us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.786458:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578831.786469:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053056 00000100:00100000:1.0:1789578831.786473:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053056 00000100:00100000:1.0:1789578831.786490:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789578831.786497:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277052800:12345-0@lo:400: 00000100:00100000:3.0:1789578831.786509:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:8645:x1876509277053568:12345-0@lo:502: Request processed in 119us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.786516:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1789578831.786596:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930289ea00 x1876509277052672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789578841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578831.786606:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277052800:12345-0@lo:400: Request processed in 107us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.786611:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789578831.786616:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789578831.786621:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789578831.786637:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1789578831.786638:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789578831.786645:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:1.0:1789578831.786650:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277053312:12345-0@lo:400: 00000100:00080000:2.0:1789578831.786651:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93930232c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789578831.786672:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789578831.786681:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277052672:0@lo:8: 00000100:00100000:1.0:1789578831.786688:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277053312:12345-0@lo:400: Request processed in 39us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.786695:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1789578831.786708:0:8648:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789578831.786720:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789578831.786728:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277053440:12345-0@lo:400: 00000100:00100000:1.0:1789578831.786763:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277053440:12345-0@lo:400: Request processed in 36us (668us total) trans 0 rc 0/0 00000004:00080000:2.0:1789578831.786764:0:8648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 186919411969ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789578831.786772:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00080000:00080000:2.0:1789578831.786774:0:8648:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789578831.786787:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789578831.786795:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277053056:12345-0@lo:400: 00000100:00100000:1.0:1789578831.786823:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277053056:12345-0@lo:400: Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.786829:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789578831.786865:0:8645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8645:1876509277053568:0@lo:502: 00000020:01000000:1.0:1789578831.786892:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578831.786966:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578831.786970:0:8645:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789578831.786975:0:8645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789578831.787102:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789578831.787125:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789578831.787134:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.787373:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277053184:0@lo:400: 00010000:00080000:0.0:1789578831.787398:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437205500 x1876509277052800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.787407:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277052800:0@lo:400: 00010000:00080000:0.0:1789578831.787416:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437206a00 x1876509277053312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.787424:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277053312:0@lo:400: 00000100:00080000:0.0:1789578831.787447:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578831.787452:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789578831.787479:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437207100 x1876509277053056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.787488:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277053056:0@lo:400: 00000100:00100000:0.0:1789578831.787499:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277052928:0@lo:400: 00010000:00080000:0.0:1789578831.787509:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437205180 x1876509277053440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.787516:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277053440:0@lo:400: 00010000:00010000:1.0:1789578831.788481:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578831.788497:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789578831.788500:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940679b000 from 30 10000000:01000000:1.0:1789578831.788503:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789578831.788535:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.788553:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.788563:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578831.788582:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277053696:0@lo:101: 00000100:00100000:1.0:1789578831.788633:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.788666:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.788684:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053696 00000100:00100000:1.0:1789578831.788690:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053696 00000100:00100000:1.0:1789578831.788729:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789578831.788738:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277053696:12345-0@lo:101: 00010000:00010000:1.0:1789578831.788748:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578831.788762:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20b29 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789578831.788774:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:1.0:1789578831.788795:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20b29 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.788807:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b29 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.788815:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401687400, rc 0) 00000100:00100000:1.0:1789578831.788844:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277053696:12345-0@lo:101: Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.788931:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277053696:0@lo:101: 00010000:00010000:0.0:1789578831.788944:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.788953:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.789017:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277053824:0@lo:501: 00000100:00100000:0.0:1789578831.789043:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.789075:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578831.789456:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053824 00000100:00100000:2.0:1789578831.789461:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053824 00000100:00100000:1.0:1789578831.790031:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789578831.792475:0:8650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277053952:0@lo:700: 00000100:00100000:3.0:1789578831.792552:0:8650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.792744:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277053952 00000100:00100000:3.0:1789578831.792752:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277053952 00000100:00100000:3.0:1789578831.792803:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789578831.792812:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8650:x1876509277053952:12345-0@lo:700: 00000100:00100000:3.0:1789578831.792919:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1876509277054080:0@lo:700: 00000100:00100000:3.0:1789578831.792947:0:8411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.792968:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058300 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.793001:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054080 00000100:00100000:3.0:1789578831.793004:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054080 00000100:00100000:3.0:1789578831.793029:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789578831.793035:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1876509277054080:12345-0@lo:700: 00000100:00100000:3.0:1789578831.793147:0:8650:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058180 going to sleep for 11 seconds 00000100:00080000:0.0:1789578831.793209:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578831.794779:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789578831.794797:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277053824:12345-0@lo:501: 00000100:00100000:2.0:1789578831.794963:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277053824:12345-0@lo:501: Request processed in 172us (5918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.794972:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789578831.795620:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277053824:0@lo:501: 00000100:00100000:3.0:1789578831.795673:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054208:0@lo:503: 00000100:00100000:3.0:1789578831.795723:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.795761:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.796063:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054208 00000100:00100000:0.0:1789578831.796071:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054208 00000100:00100000:0.0:1789578831.796118:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789578831.796127:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277054208:12345-0@lo:503: 00000100:00100000:0.0:1789578831.796343:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277054208:12345-0@lo:503: Request processed in 216us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.796378:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789578831.796429:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054208:0@lo:503: 00000100:00100000:0.0:1789578831.797573:0:8653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8653:1876509277054336:0@lo:502: 00000100:00100000:0.0:1789578831.797936:0:8653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.797976:0:8653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.797981:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054336 00000100:00100000:1.0:1789578831.798004:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054336 00000100:00100000:1.0:1789578831.798051:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789578831.798060:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8653:x1876509277054336:12345-0@lo:502: 00000100:00100000:1.0:1789578831.798181:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8653:x1876509277054336:12345-0@lo:502: Request processed in 121us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.798188:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789578831.798578:0:8653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8653:1876509277054336:0@lo:502: 00000100:00100000:0.0:1789578831.798646:0:8653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8653:1876509277054464:0@lo:502: 00000100:00100000:0.0:1789578831.798683:0:8653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.798715:0:8653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.798760:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054464 00000100:00100000:3.0:1789578831.798766:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054464 00000100:00100000:3.0:1789578831.798800:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789578831.798808:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8653:x1876509277054464:12345-0@lo:502: 00000100:00100000:3.0:1789578831.798903:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:8653:x1876509277054464:12345-0@lo:502: Request processed in 95us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.798910:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789578831.799107:0:8653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8653:1876509277054464:0@lo:502: 00000040:00080000:0.0:1789578831.799127:0:8653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789578831.799464:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789578831.799487:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789578831.799496:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.799509:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578831.799526:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789578831.799529:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940679b000 from 5 10000000:01000000:3.0:1789578831.799531:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789578831.799555:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.799563:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578831.799572:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578831.799585:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054592:0@lo:101: 00000100:00100000:3.0:1789578831.799627:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.799658:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.799700:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054592 00000100:00100000:0.0:1789578831.799705:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054592 00000100:00100000:0.0:1789578831.799738:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789578831.799744:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277054592:12345-0@lo:101: 00010000:00010000:0.0:1789578831.799754:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578831.799766:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20b37 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.799796:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20b37 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.799806:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b37 expref: 19 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.799813:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031400, rc 0) 00000100:00100000:0.0:1789578831.799858:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277054592:12345-0@lo:101: Request processed in 114us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.799864:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789578831.799897:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054592:0@lo:101: 00010000:00010000:0.0:1789578831.799910:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.799918:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.799959:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054720:0@lo:256: 00000100:00100000:0.0:1789578831.800001:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.800019:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.800152:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054720 00000100:00100000:3.0:1789578831.800157:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054720 00000100:00100000:3.0:1789578831.800187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789578831.800193:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277054720:12345-0@lo:256: 20000000:01000000:3.0:1789578831.800205:0:6484:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789578831.800220:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789578831.800223:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789578831.800316:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277054720:12345-0@lo:256: Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.800323:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 40000000:02000000:2.0:1789578831.800684:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789578831.801363:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054720:0@lo:256: 10000000:01000000:0.0:1789578831.801422:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789578831.801431:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.801441:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578831.801457:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789578831.801460:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789578831.801463:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789578831.801491:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.801499:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.801508:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.801524:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054848:0@lo:101: 00000100:00100000:0.0:1789578831.801564:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.801618:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.801813:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054848 00000100:00100000:1.0:1789578831.801820:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054848 00000100:00100000:1.0:1789578831.801865:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789578831.801873:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277054848:12345-0@lo:101: 00010000:00010000:1.0:1789578831.801884:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578831.801981:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20b45 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.802013:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20b45 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.802022:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b45 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578831.802040:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f400, rc 0) 00000100:00100000:1.0:1789578831.802078:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277054848:12345-0@lo:101: Request processed in 206us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.802085:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789578831.802116:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054848:0@lo:101: 00010000:00010000:0.0:1789578831.802129:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.802137:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.802196:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054976:0@lo:501: 00000100:00100000:0.0:1789578831.802339:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.802415:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.802493:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277054976 00000100:00100000:1.0:1789578831.802498:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277054976 00000100:00100000:1.0:1789578831.802527:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789578831.802534:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277054976:12345-0@lo:501: 00000100:00100000:1.0:1789578831.802640:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277054976:12345-0@lo:501: Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.802652:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789578831.802680:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277054976:0@lo:501: 00000100:00100000:0.0:1789578831.802707:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055104:0@lo:503: 00000100:00100000:0.0:1789578831.802750:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.802769:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.803407:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055104 00000100:00100000:1.0:1789578831.803414:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055104 00000100:00100000:1.0:1789578831.803441:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789578831.803447:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277055104:12345-0@lo:503: 00000100:00100000:1.0:1789578831.803533:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277055104:12345-0@lo:503: Request processed in 86us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.803539:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789578831.805438:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055104:0@lo:503: 00000100:00100000:3.0:1789578831.808557:0:8655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8655:1876509277055232:0@lo:502: 00000100:00100000:3.0:1789578831.808639:0:8655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.808693:0:8655:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058780 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.808742:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055232 00000100:00100000:0.0:1789578831.808750:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055232 00000100:00100000:0.0:1789578831.808795:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789578831.808805:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:8655:x1876509277055232:12345-0@lo:502: 00000100:00100000:0.0:1789578831.810535:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:8655:x1876509277055232:12345-0@lo:502: Request processed in 1725us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.810549:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789578831.810662:0:8655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8655:1876509277055232:0@lo:502: 00000020:01000000:3.0:1789578831.810703:0:8655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789578831.810711:0:8655:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789578831.810718:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578831.810721:0:8655:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789578831.810727:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789578831.810731:0:8655:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789578831.810754:0:8655:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789578831.810758:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789578831.810774:0:8655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9393020d99c0) 00000020:00000080:3.0:1789578831.810798:0:8655:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789578831.810805:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789578831.810951:0:8655:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789578831.810959:0:8655:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789578831.810978:0:8655:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f20b5a 00010000:00080000:3.0:1789578831.811021:0:8655:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302b55000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578831.811276:0:8655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1789578831.815164:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1876509277054080:12345-0@lo:700: Request processed in 22121us (22207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.815177:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789578831.815400:0:8411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2d80 x1876509277054080/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578831.815417:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1876509277054080:0@lo:700: 40000000:02000000:3.0:1789578831.815430:0:8411:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1789578831.825961:0:8655:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789578831.825996:0:8655:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789578831.826244:0:8655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578831.827732:0:8655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578831.827895:0:8655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789578831.828026:0:8655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789578831.828740:0:8662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789578831.828752:0:8662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1789578831.830125:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789578831.830311:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277053952:12345-0@lo:700: Request processed in 37494us (37753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.830324:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789578831.830623:0:8650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2a00 x1876509277053952/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.830636:0:8650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277053952:0@lo:700: 00000020:00000080:3.0:1789578831.831438:0:8655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789578831.831454:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789578831.831724:0:8655:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789578831.831748:0:8655:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20b61 00000100:00080000:3.0:1789578831.831758:0:8655:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789578831.831767:0:8655:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939302b55000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789578831.831799:0:8655:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9394362d2d80 x1876509277055360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789578831.831829:0:8655:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789578831.831903:0:8655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578831.831908:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578831.831909:0:8655:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789578831.831913:0:8655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578831.831917:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578831.831919:0:8655:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789578831.831921:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789578831.831923:0:8655:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789578831.831951:0:8655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8655:1876509277055488:0@lo:502: 00000100:00100000:3.0:1789578831.832032:0:8655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.832064:0:8655:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789578831.832143:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277055360:0@lo:8: 00000100:00100000:2.0:1789578831.832181:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.832334:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055488 00000100:00100000:0.0:1789578831.832341:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055488 00000100:00100000:0.0:1789578831.832409:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789578831.832419:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:8655:x1876509277055488:12345-0@lo:502: 00000100:00100000:3.0:1789578831.832967:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055360 00000100:00100000:3.0:1789578831.832974:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055360 00000100:00100000:3.0:1789578831.833019:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789578831.833028:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277055360:12345-0@lo:8: 00010000:00080000:3.0:1789578831.833053:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1789578831.833094:0:8405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20b68 00002000:00100000:3.0:1789578831.833109:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff939302b51000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789578831.833113:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789578831.833115:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789578831.833198:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789578831.833221:0:8405:0:(import.c:65:import_set_state_nolock()) ffff939302b52000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578831.833279:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277055360:12345-0@lo:8: Request processed in 252us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.833286:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789578831.833330:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2d80 x1876509277055360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789578841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578831.833341:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789578831.833373:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789578831.833381:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789578831.833386:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789578831.833388:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b55000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789578831.833400:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789578831.833405:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277055360:0@lo:8: 00000004:00080000:3.0:1789578831.833430:0:8662:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789578831.833477:0:8662:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 186966125479ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789578831.833483:0:8662:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789578831.833814:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:8655:x1876509277055488:12345-0@lo:502: Request processed in 1394us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.833822:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789578831.834177:0:8655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:8655:1876509277055488:0@lo:502: 00000020:01000000:3.0:1789578831.834212:0:8655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578831.834219:0:8655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578831.834222:0:8655:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789578831.834226:0:8655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789578831.834724:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789578831.834751:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789578831.834763:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.834786:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578831.834796:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789578831.834799:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93941008b380 from 1 10000000:01000000:0.0:1789578831.834802:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789578831.834832:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.834840:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.834848:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.834866:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055616:0@lo:101: 00000100:00100000:0.0:1789578831.834909:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.834942:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.834960:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055616 00000100:00100000:0.0:1789578831.834965:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055616 00000100:00100000:0.0:1789578831.835014:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578831.835022:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277055616:12345-0@lo:101: 00010000:00010000:0.0:1789578831.835034:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578831.836296:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20b6f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.836330:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.836369:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.836379:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436400, rc 0) 00000100:00100000:0.0:1789578831.836441:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277055616:12345-0@lo:101: Request processed in 1419us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578831.836449:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578831.837092:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055616:0@lo:101: 00010000:00010000:0.0:1789578831.837114:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.837124:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578831.837198:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055744:0@lo:501: 00000100:00100000:0.0:1789578831.837234:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.837263:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.837282:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055744 00000100:00100000:0.0:1789578831.837287:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055744 00000100:00100000:0.0:1789578831.837319:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789578831.837326:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277055744:12345-0@lo:501: 00000100:00100000:0.0:1789578831.837415:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277055744:12345-0@lo:501: Request processed in 89us (181us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789578831.837422:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789578831.837457:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277055744:0@lo:501: 10000000:01000000:0.0:1789578831.837486:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789578831.837511:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578831.838738:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789578831.838947:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789578831.842143:0:8650:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789578831.842176:0:8650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056000:0@lo:7: 00000100:00100000:0.0:1789578831.842244:0:8650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.842292:0:8650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.842311:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277055872:0@lo:13: 00000100:00100000:0.0:1789578831.842336:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.842460:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056000 00000100:00100000:3.0:1789578831.842468:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056000 00000100:00100000:3.0:1789578831.842529:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789578831.842539:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277056000:12345-0@lo:7: 00000100:00100000:2.0:1789578831.844539:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277055872 00000100:00100000:2.0:1789578831.844549:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277055872 00000100:00100000:2.0:1789578831.844596:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789578831.844605:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277055872:12345-0@lo:13: 00002000:00000024:2.0:1789578831.844633:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923886080 avail 3692363776 00000100:00100000:2.0:1789578831.844726:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277055872:12345-0@lo:13: Request processed in 121us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578831.844733:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789578831.845024:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c000 x1876509277055872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578831.845047:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277055872:0@lo:13: 00002000:00080000:3.0:1789578831.851917:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789578831.851926:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789578831.852031:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277056000:12345-0@lo:7: Request processed in 9491us (9784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.852042:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578831.852156:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277056128:0@lo:13: 00000100:00100000:2.0:1789578831.852200:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789578831.852249:0:8663:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789578831.852272:0:8663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056256:0@lo:7: 00000100:00100000:3.0:1789578831.852299:0:8663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.852318:0:8663:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505480 going to sleep for 11 seconds 00010000:00080000:0.0:1789578831.852395:0:8650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ed80 x1876509277056000/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.852411:0:8650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056000:0@lo:7: 00000004:00080000:0.0:1789578831.852423:0:8650:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789578831.852450:0:8650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056384:0@lo:5: 00000100:00100000:0.0:1789578831.852476:0:8650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.852514:0:8650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578831.852637:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056128 00000100:00100000:3.0:1789578831.852645:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056128 00000100:00080000:0.0:1789578831.852677:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578831.852710:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789578831.852720:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277056128:12345-0@lo:13: 00000100:00100000:0.0:1789578831.852721:0:8407:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789578831.852730:0:8407:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1789578831.852742:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923886080 avail 3692363776 00000100:00100000:1.0:1789578831.852808:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056256 00000100:00100000:1.0:1789578831.852813:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056256 00000100:00100000:1.0:1789578831.852841:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056384 00000100:00100000:1.0:1789578831.852845:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056384 00000100:00100000:1.0:1789578831.852858:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789578831.852865:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8663:x1876509277056256:12345-0@lo:7: 00000100:00100000:3.0:1789578831.856073:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277056128:12345-0@lo:13: Request processed in 3348us (3864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.856087:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:1.0:1789578831.857333:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789578831.857341:0:8405:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:2.0:1789578831.857456:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d0e00 x1876509277056128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578831.857483:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277056128:0@lo:13: 00000100:00100000:1.0:1789578831.857797:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8663:x1876509277056256:12345-0@lo:7: Request processed in 4931us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.857807:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789578831.857831:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578831.857843:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277056384:12345-0@lo:5: 00002000:00080000:1.0:1789578831.857871:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789578831.857914:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277056384:12345-0@lo:5: Request processed in 74us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.857932:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789578831.858551:0:8650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ed80 x1876509277056384/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.858565:0:8650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056384:0@lo:5: 00000004:00080000:0.0:1789578831.858578:0:8650:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789578831.858648:0:8650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056512:0@lo:5: 00000100:00100000:0.0:1789578831.858689:0:8650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.858729:0:8650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.858763:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056512 00000100:00100000:0.0:1789578831.858769:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056512 00000100:00100000:0.0:1789578831.858809:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789578831.858817:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8650:x1876509277056512:12345-0@lo:5: 00002000:00080000:0.0:1789578831.858846:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789578831.860805:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8650:x1876509277056512:12345-0@lo:5: Request processed in 1983us (2110us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789578831.860817:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789578831.861457:0:8663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2d80 x1876509277056256/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578831.861473:0:8663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056256:0@lo:7: 00000004:00080000:3.0:1789578831.861486:0:8663:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789578831.861650:0:8663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056640:0@lo:5: 00000100:00100000:3.0:1789578831.861704:0:8663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.861744:0:8663:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505480 going to sleep for 11 seconds 00010000:00080000:1.0:1789578831.861841:0:8650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ed80 x1876509277056512/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578831.861854:0:8650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8650:1876509277056512:0@lo:5: 00000004:00080000:1.0:1789578831.861866:0:8650:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789578831.861895:0:8650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8650:1876509277056768:0@lo:900: 00000100:00100000:1.0:1789578831.861925:0:8650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578831.861947:0:8650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578831.861973:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056768 00000100:00100000:1.0:1789578831.861979:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056768 00000100:00100000:1.0:1789578831.862039:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578831.862050:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8650:x1876509277056768:12345-0@lo:900: 00000100:00100000:1.0:1789578831.862100:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8650:x1876509277056768:12345-0@lo:900: Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578831.862107:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789578831.862138:0:8650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930289d500 x1876509277056768/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578831.862149:0:8650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8650:1876509277056768:0@lo:900: 00000100:00100000:2.0:1789578831.862209:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056640 00000100:00100000:2.0:1789578831.862214:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056640 00000100:00100000:2.0:1789578831.862251:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789578831.862259:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8663:x1876509277056640:12345-0@lo:5: 00002000:00080000:2.0:1789578831.862280:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789578831.862284:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1789578831.873137:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1789578831.873154:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789578831.873165:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789578831.873295:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8663:x1876509277056640:12345-0@lo:5: Request processed in 11032us (11586us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789578831.873306:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789578831.873318:0:8663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2d80 x1876509277056640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578831.873332:0:8663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789578831.873340:0:8663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056640:0@lo:5: 00000004:00080000:3.0:1789578831.873384:0:8663:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789578831.873432:0:8663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056896:0@lo:700: 00000100:00100000:3.0:1789578831.873469:0:8663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578831.873514:0:8663:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409505480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578831.874671:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277056896 00000100:00100000:0.0:1789578831.874683:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277056896 00000100:00100000:0.0:1789578831.874739:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789578831.874750:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8663:x1876509277056896:12345-0@lo:700: 00000100:00100000:3.0:1789578831.894176:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8663:x1876509277056896:12345-0@lo:700: Request processed in 19421us (20701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578831.894200:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789578831.894291:0:8663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9394362d2d80 x1876509277056896/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578831.894306:0:8663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277056896:0@lo:700: 00000004:02000040:2.0:1789578831.895645:0:8663:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789578831.900273:0:8663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277057024:0@lo:5: 00000100:00100000:0.0:1789578831.900635:0:8663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578831.900681:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057024 00000100:00100000:0.0:1789578831.900689:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057024 00000100:00100000:0.0:1789578831.900734:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789578831.900743:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8663:x1876509277057024:12345-0@lo:5: 00000100:00100000:1.0:1789578831.902426:0:8663:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942906ee40 going to sleep for 11 seconds 00002000:00080000:0.0:1789578831.908159:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789578831.908180:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789578831.909741:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8663:x1876509277057024:12345-0@lo:5: Request processed in 8992us (9099us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789578831.909754:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789578831.909815:0:8663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d180 x1876509277057024/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578831.909834:0:8663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8663:1876509277057024:0@lo:5: 00000004:00080000:0.0:1789578831.909851:0:8663:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789578831.979544:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578833.002849:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578833.251827:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277057152:0@lo:41: 00000100:00100000:0.0:1789578833.251946:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277057280:0@lo:41: 00000100:00100000:0.0:1789578833.252026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578833.252291:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578833.252331:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057280 00000100:00100000:1.0:1789578833.252338:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057280 00000100:00100000:1.0:1789578833.252397:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057152 00000100:00100000:1.0:1789578833.252401:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057152 00000100:00100000:1.0:1789578833.252431:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578833.252438:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277057280:12345-0@lo:41: 00000004:00000024:1.0:1789578833.252472:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789578833.252931:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277057280:12345-0@lo:41: Request processed in 491us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578833.252939:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578833.252958:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789578833.252965:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277057152:12345-0@lo:41: 00000004:00000024:1.0:1789578833.252996:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789578833.253032:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277057152:12345-0@lo:41: Request processed in 68us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578833.253038:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789578833.253080:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277057280:0@lo:41: 00000100:00100000:1.0:1789578833.253109:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277057152:0@lo:41: 00000001:02000400:0.0:1789578833.648698:0:8781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789578834.019748:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789578834.600079:0:8834:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578834.600471:0:8834:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789578835.045557:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789578835.420131:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1789578836.068171:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578836.837732:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277057408:0@lo:400: 00000100:00100000:3.0:1789578836.837966:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277057792:0@lo:400: 00000100:00100000:3.0:1789578836.838011:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.838302:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.838383:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277057920:0@lo:400: 00000100:00100000:1.0:1789578836.838413:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.838435:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277058432:0@lo:400: 00000100:00100000:1.0:1789578836.838463:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578836.842162:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277058304:0@lo:400: 00000100:00100000:3.0:1789578836.842231:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578836.842391:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057792 00000100:00100000:2.0:1789578836.842400:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057792 00000100:00100000:2.0:1789578836.842463:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789578836.842473:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277057792:12345-0@lo:400: 00000100:00100000:2.0:1789578836.842531:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277057792:12345-0@lo:400: Request processed in 60us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578836.842553:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789578836.842597:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d2300 x1876509277057792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578836.842611:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277057792:0@lo:400: 00000100:00100000:1.0:1789578836.842738:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277057536:0@lo:400: 00000100:00100000:1.0:1789578836.842771:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.842795:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277058048:0@lo:400: 00000100:00100000:1.0:1789578836.842816:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.842841:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789578836.842848:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277057664:0@lo:400: 00000100:00100000:1.0:1789578836.842874:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.842893:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277058176:0@lo:400: 00000100:00100000:1.0:1789578836.842912:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578836.842938:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057408 00000100:00100000:1.0:1789578836.842944:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057408 00000100:00100000:1.0:1789578836.842988:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789578836.842995:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3618:x1876509277057408:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843046:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3618:x1876509277057408:12345-0@lo:400: Request processed in 51us (4743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843052:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789578836.843082:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057920 00000100:00100000:1.0:1789578836.843085:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057920 00000100:00100000:1.0:1789578836.843101:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057664 00000100:00100000:1.0:1789578836.843103:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057664 00000100:00100000:1.0:1789578836.843116:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578836.843121:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277057920:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843157:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277057920:12345-0@lo:400: Request processed in 35us (4743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843162:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578836.843174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789578836.843180:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277057664:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843213:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277057664:12345-0@lo:400: Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843218:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789578836.843238:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058432 00000100:00100000:1.0:1789578836.843250:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058432 00000100:00100000:1.0:1789578836.843285:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058304 00000100:00100000:1.0:1789578836.843288:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058304 00000100:00100000:1.0:1789578836.843311:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578836.843319:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277058432:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843378:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277058432:12345-0@lo:400: Request processed in 61us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843384:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789578836.843396:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578836.843403:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277058304:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843436:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277058304:12345-0@lo:400: Request processed in 33us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843442:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789578836.843459:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277057536 00000100:00100000:1.0:1789578836.843462:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277057536 00000100:00100000:1.0:1789578836.843478:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058048 00000100:00100000:1.0:1789578836.843481:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058048 00000100:00100000:1.0:1789578836.843494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058176 00000100:00100000:1.0:1789578836.843497:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058176 00000100:00100000:1.0:1789578836.843510:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789578836.843516:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277057536:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843840:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277057536:12345-0@lo:400: Request processed in 322us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843848:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789578836.843863:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789578836.843869:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277058048:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843897:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277058048:12345-0@lo:400: Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843912:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789578836.843923:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789578836.843929:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277058176:12345-0@lo:400: 00000100:00100000:1.0:1789578836.843968:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277058176:12345-0@lo:400: Request processed in 39us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578836.843972:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789578836.843996:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578836.843999:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578836.844002:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789578836.844160:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277057664:0@lo:400: 00010000:00080000:1.0:1789578836.844176:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d1c00 x1876509277058176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578836.844185:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277058176:0@lo:400: 00010000:00080000:1.0:1789578836.844196:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d2680 x1876509277057536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578836.844203:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277057536:0@lo:400: 00010000:00080000:1.0:1789578836.844213:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d3b80 x1876509277058048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578836.844221:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277058048:0@lo:400: 00000100:00100000:1.0:1789578836.844254:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277057408:0@lo:400: 00000100:00100000:1.0:1789578836.844265:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277057920:0@lo:400: 00010000:00080000:1.0:1789578836.844277:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d2d80 x1876509277058432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578836.844297:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789578836.844309:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277058432:0@lo:400: 00010000:00080000:2.0:1789578836.844633:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d1880 x1876509277058304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578836.844642:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789578836.844653:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277058304:0@lo:400: 00010000:00010000:0.0:1789578837.092245:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789578837.310305:0:8935:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578837.310728:0:8935:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789578837.348555:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277058560:0@lo:13: 00000100:00100000:1.0:1789578837.348628:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578837.348706:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058560 00000100:00100000:1.0:1789578837.348714:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058560 00000100:00100000:1.0:1789578837.348763:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578837.348773:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277058560:12345-0@lo:13: 00002000:00000024:1.0:1789578837.348801:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578837.348844:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277058560:12345-0@lo:13: Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578837.348851:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789578837.348893:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d1880 x1876509277058560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578837.348911:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277058560:0@lo:13: 00000100:00100000:1.0:1789578837.349167:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789578837.349176:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277058688:0@lo:13: 00000100:00100000:1.0:1789578837.349202:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578837.349266:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058688 00000100:00100000:2.0:1789578837.349271:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058688 00000100:00100000:2.0:1789578837.349302:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578837.349309:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277058688:12345-0@lo:13: 00002000:00000024:2.0:1789578837.349318:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578837.349387:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277058688:12345-0@lo:13: Request processed in 40us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578837.349395:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789578837.349463:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93942a0d2300 x1876509277058688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578837.349477:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277058688:0@lo:13: 00010000:00010000:0.0:1789578838.116338:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789578838.194533:0:8983:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578838.194540:0:8983:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789578838.372236:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277058816:0@lo:41: 00000100:00100000:0.0:1789578838.372308:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578838.372396:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058816 00000100:00100000:0.0:1789578838.372403:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058816 00000100:00100000:0.0:1789578838.372739:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789578838.372749:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277058816:12345-0@lo:41: 00000004:00000024:0.0:1789578838.372783:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789578838.372823:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277058816:12345-0@lo:41: Request processed in 76us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578838.372830:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789578838.375543:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277058944:0@lo:41: 00000100:00100000:1.0:1789578838.375609:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578838.375670:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277058944 00000100:00100000:1.0:1789578838.375688:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277058944 00000100:00100000:1.0:1789578838.375724:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789578838.375732:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277058944:12345-0@lo:41: 00000004:00000024:1.0:1789578838.375766:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789578838.375808:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277058944:12345-0@lo:41: Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578838.375814:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789578838.375857:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277058944:0@lo:41: 00000100:00100000:0.0:1789578838.376450:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277058816:0@lo:41: 00010000:00010000:2.0:1789578839.139795:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578840.169775:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578841.189810:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578841.955607:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277059072:0@lo:400: 00000100:00100000:2.0:1789578841.955612:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277059328:0@lo:400: 00000100:00100000:0.0:1789578841.955729:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277059456:0@lo:400: 00000100:00100000:3.0:1789578841.955774:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277059200:0@lo:400: 00000100:00100000:2.0:1789578841.957423:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578841.957494:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277059840:0@lo:400: 00000100:00100000:2.0:1789578841.957530:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578841.957575:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059328 00000100:00100000:2.0:1789578841.957594:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059328 00000100:00100000:2.0:1789578841.957642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789578841.957651:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277059328:12345-0@lo:400: 00000100:00100000:2.0:1789578841.957708:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277059328:12345-0@lo:400: Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578841.957715:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789578841.957736:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059840 00000100:00100000:2.0:1789578841.957740:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059840 00000100:00100000:2.0:1789578841.957777:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789578841.957784:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277059840:12345-0@lo:400: 00000100:00100000:2.0:1789578841.957816:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277059840:12345-0@lo:400: Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578841.957822:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789578841.959085:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789578841.959177:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789578841.959217:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ca80 x1876509277059840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578841.959234:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277059840:0@lo:400: 00000100:00100000:2.0:1789578841.959245:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277059328:0@lo:400: 00000100:00100000:0.0:1789578841.960258:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059072 00000100:00100000:0.0:1789578841.960269:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059072 00000100:00100000:0.0:1789578841.960321:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789578841.960329:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3615:x1876509277059072:12345-0@lo:400: 00000100:00100000:0.0:1789578841.960798:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3615:x1876509277059072:12345-0@lo:400: Request processed in 467us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578841.960806:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789578841.961091:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578841.961236:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277059712:0@lo:400: 00000100:00100000:3.0:1789578841.961265:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578841.961326:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277059072:0@lo:400: 00000100:00100000:1.0:1789578841.961376:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277059584:0@lo:400: 00000100:00100000:1.0:1789578841.961406:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578841.961430:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277060096:0@lo:400: 00000100:00100000:1.0:1789578841.964600:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578841.964649:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060096 00000100:00100000:1.0:1789578841.964657:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060096 00000100:00100000:1.0:1789578841.964720:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578841.964732:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277060096:12345-0@lo:400: 00000100:00100000:1.0:1789578841.964783:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277060096:12345-0@lo:400: Request processed in 55us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578841.964791:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789578841.965179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789578841.965626:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c700 x1876509277060096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578841.965640:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277060096:0@lo:400: 00000100:00100000:1.0:1789578841.966601:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059584 00000100:00100000:1.0:1789578841.966612:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059584 00000100:00100000:1.0:1789578841.966660:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789578841.966669:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277059584:12345-0@lo:400: 00000100:00100000:1.0:1789578841.966745:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277059584:12345-0@lo:400: Request processed in 77us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578841.966752:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789578841.966791:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277059584:0@lo:400: 00000100:00100000:2.0:1789578841.969025:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059200 00000100:00100000:2.0:1789578841.969039:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059200 00000100:00100000:3.0:1789578841.969792:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059712 00000100:00100000:3.0:1789578841.969799:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059712 00000100:00080000:3.0:1789578841.969843:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578841.969869:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789578841.969878:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277059200:12345-0@lo:400: 00000100:00100000:3.0:1789578841.969972:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277059200:12345-0@lo:400: Request processed in 95us (8880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578841.969980:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789578841.970036:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4f100 x1876509277059200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578841.970051:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277059200:0@lo:400: 00000100:00100000:3.0:1789578841.970092:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789578841.970100:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277059712:12345-0@lo:400: 00000100:00100000:3.0:1789578841.970137:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277059712:12345-0@lo:400: Request processed in 38us (8871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578841.970143:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789578841.970171:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d180 x1876509277059712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578841.970180:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277059712:0@lo:400: 00000100:00100000:0.0:1789578841.970945:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578841.971019:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277059968:0@lo:400: 00000100:00100000:0.0:1789578841.971056:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578841.972585:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059968 00000100:00100000:2.0:1789578841.972598:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059968 00000100:00100000:2.0:1789578841.972671:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789578841.972681:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277059968:12345-0@lo:400: 00000100:00100000:2.0:1789578841.972751:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277059968:12345-0@lo:400: Request processed in 71us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578841.972758:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789578841.972810:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c000 x1876509277059968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578841.972825:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277059968:0@lo:400: 00000100:00080000:0.0:1789578841.972955:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578841.973523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277059456 00000100:00100000:3.0:1789578841.973531:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277059456 00000100:00100000:3.0:1789578841.973609:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789578841.973617:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277059456:12345-0@lo:400: 00000100:00100000:3.0:1789578841.973678:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277059456:12345-0@lo:400: Request processed in 62us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578841.973685:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789578841.973748:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4d880 x1876509277059456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578841.973759:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277059456:0@lo:400: 00010000:00010000:1.0:1789578842.213463:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578842.474108:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277060224:0@lo:13: 00000100:00100000:1.0:1789578842.474172:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578842.474234:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277060352:0@lo:13: 00000100:00100000:1.0:1789578842.474256:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578842.474287:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060224 00000100:00100000:1.0:1789578842.474294:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060224 00000100:00100000:1.0:1789578842.474330:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060352 00000100:00100000:1.0:1789578842.474333:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060352 00000100:00100000:1.0:1789578842.474346:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578842.474377:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277060224:12345-0@lo:13: 00002000:00000024:1.0:1789578842.476831:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578842.476931:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277060224:12345-0@lo:13: Request processed in 2552us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578842.476941:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789578842.476978:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789578842.476991:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277060352:12345-0@lo:13: 00002000:00000024:1.0:1789578842.477008:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578842.477053:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277060352:12345-0@lo:13: Request processed in 68us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578842.477059:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789578842.477116:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93940f40d880 x1876509277060352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578842.477136:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277060352:0@lo:13: 00010000:00080000:1.0:1789578842.477174:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93940f40ea00 x1876509277060224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578842.477188:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277060224:0@lo:13: 00010000:00010000:2.0:1789578843.235541:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578843.491649:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578843.491676:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277060480:0@lo:41: 00000100:00100000:3.0:1789578843.491749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578843.491909:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060480 00000100:00100000:1.0:1789578843.491917:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060480 00000100:00100000:1.0:1789578843.491974:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789578843.491983:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277060480:12345-0@lo:41: 00000004:00000024:1.0:1789578843.492014:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789578843.492058:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277060480:12345-0@lo:41: Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578843.492065:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578843.492144:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277060480:0@lo:41: 00000100:00100000:3.0:1789578843.493449:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578843.493466:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277060608:0@lo:41: 00000100:00100000:3.0:1789578843.493528:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578843.493572:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060608 00000100:00100000:3.0:1789578843.493578:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060608 00000100:00100000:3.0:1789578843.493617:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789578843.493626:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277060608:12345-0@lo:41: 00000004:00000024:3.0:1789578843.493651:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789578843.493696:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277060608:12345-0@lo:41: Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578843.493703:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578843.493770:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277060608:0@lo:41: 00010000:00010000:1.0:1789578844.259808:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578845.284046:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578846.309441:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578847.076076:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277060992:0@lo:400: 00000100:00100000:3.0:1789578847.076230:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277060736:0@lo:400: 00000100:00100000:0.0:1789578847.076368:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.076449:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.076488:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277061504:0@lo:400: 00000100:00100000:3.0:1789578847.076492:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277061248:0@lo:400: 00000100:00100000:3.0:1789578847.076528:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.076539:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.076552:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277061760:0@lo:400: 00000100:00100000:0.0:1789578847.076569:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789578847.076577:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277060864:0@lo:400: 00000100:00100000:3.0:1789578847.076584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.076614:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.076628:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789578847.076636:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277061376:0@lo:400: 00000100:00100000:3.0:1789578847.076639:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277061120:0@lo:400: 00000100:00100000:3.0:1789578847.076670:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.076689:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060992 00000100:00100000:0.0:1789578847.076697:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060992 00000100:00100000:3.0:1789578847.076701:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277061632:0@lo:400: 00000100:00100000:3.0:1789578847.076730:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.076735:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061248 00000100:00100000:0.0:1789578847.076739:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061248 00000100:00100000:0.0:1789578847.076760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578847.076768:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277060992:12345-0@lo:400: 00000100:00100000:3.0:1789578847.076938:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060736 00000100:00100000:3.0:1789578847.076950:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060736 00000100:00100000:3.0:1789578847.076996:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789578847.077003:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3616:x1876509277060736:12345-0@lo:400: 00000100:00100000:3.0:1789578847.077174:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3616:x1876509277060736:12345-0@lo:400: Request processed in 171us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.077182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789578847.077218:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061760 00000100:00100000:3.0:1789578847.077223:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061760 00000100:00100000:2.0:1789578847.077269:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277060736:0@lo:400: 00000100:00100000:3.0:1789578847.077465:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061632 00000100:00100000:3.0:1789578847.077470:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061632 00000100:00100000:2.0:1789578847.077492:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789578847.077509:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789578847.077511:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277061760:12345-0@lo:400: 00000100:00100000:3.0:1789578847.077521:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277061632:12345-0@lo:400: 00000100:00100000:2.0:1789578847.077570:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277061760:12345-0@lo:400: Request processed in 70us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.077575:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277061632:12345-0@lo:400: Request processed in 56us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.077581:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789578847.077590:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789578847.077615:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061504 00000100:00100000:3.0:1789578847.077619:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061504 00000100:00100000:3.0:1789578847.077641:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277060864 00000100:00100000:3.0:1789578847.077645:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277060864 00000100:00100000:3.0:1789578847.077657:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061120 00000100:00100000:3.0:1789578847.077660:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061120 00010000:00080000:1.0:1789578847.077665:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437205180 x1876509277061632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.077676:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789578847.077679:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277061632:0@lo:400: 00000100:00100000:3.0:1789578847.077685:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277061504:12345-0@lo:400: 00010000:00080000:1.0:1789578847.077698:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437206300 x1876509277061760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578847.077709:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277061760:0@lo:400: 00000100:00100000:3.0:1789578847.077725:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277061504:12345-0@lo:400: Request processed in 41us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.077733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789578847.077746:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789578847.077752:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277060864:12345-0@lo:400: 00000100:00100000:0.0:1789578847.077890:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277060992:12345-0@lo:400: Request processed in 1120us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.077897:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578847.077917:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578847.077924:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277061248:12345-0@lo:400: 00000100:00100000:3.0:1789578847.077942:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277060864:12345-0@lo:400: Request processed in 188us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.077957:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789578847.077971:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789578847.077977:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277061120:12345-0@lo:400: 00000100:00100000:0.0:1789578847.078073:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277061248:12345-0@lo:400: Request processed in 149us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.078079:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789578847.078139:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277061120:12345-0@lo:400: Request processed in 161us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.078146:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789578847.078167:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578847.078170:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578847.078179:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.078216:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277060992:0@lo:400: 00010000:00080000:3.0:1789578847.078233:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4c000 x1876509277061504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.078243:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277061504:0@lo:400: 00000100:00100000:0.0:1789578847.078250:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061376 00000100:00100000:0.0:1789578847.078256:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061376 00000100:00100000:0.0:1789578847.078293:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789578847.078300:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277061376:12345-0@lo:400: 00000100:00100000:0.0:1789578847.078332:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277061376:12345-0@lo:400: Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.078337:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789578847.078418:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789578847.078455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ed80 x1876509277060864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.078465:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277060864:0@lo:400: 00010000:00080000:3.0:1789578847.078474:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4ca80 x1876509277061376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.078483:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277061376:0@lo:400: 00010000:00080000:1.0:1789578847.078579:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939302b4df80 x1876509277061120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578847.078595:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277061120:0@lo:400: 00000100:00100000:1.0:1789578847.078608:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277061248:0@lo:400: 00010000:00010000:3.0:1789578847.331931:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789578847.385183:0:9481:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789578847.385187:0:9481:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789578847.385189:0:9481:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789578847.385331:0:9481:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff939302b3c800 00000020:01000004:3.0:1789578847.385347:0:9481:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789578847.386157:0:9481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789578847.386180:0:9481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9393020dcd40) 00000020:00000080:3.0:1789578847.386198:0:9481:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789578847.439534:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789578847.439591:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789578847.481801:0:9481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789578847.482010:0:9481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789578847.482022:0:9481:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789578847.482033:0:9481:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f20b84 00000020:01000004:1.0:1789578847.482041:0:9481:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789578847.482062:0:9481:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789578847.482066:0:9481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789578847.482071:0:9481:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789578847.482106:0:9481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789578847.482110:0:9481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789578847.508776:0:9481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789578847.508920:0:9481:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789578847.508925:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789578847.508927:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789578847.508929:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578847.508930:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789578847.508931:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578847.508932:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578847.508934:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578847.508935:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789578847.508937:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789578847.508938:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578847.508940:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789578847.508943:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789578847.508946:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789578847.508947:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789578847.508948:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578847.508950:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789578847.508951:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578847.508952:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578847.508958:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578847.508960:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789578847.508961:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789578847.508962:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578847.508963:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789578847.508999:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789578847.509018:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277061888:0@lo:253: 00000100:00100000:1.0:1789578847.509084:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.509184:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100df900 going to sleep for 11 seconds 00000100:00100000:0.0:1789578847.509290:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277061888 00000100:00100000:0.0:1789578847.509298:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277061888 00000100:00100000:0.0:1789578847.509490:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789578847.509501:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:9481:x1876509277061888:12345-0@lo:253: 20000000:01000000:0.0:1789578847.509542:0:6484:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789578847.509552:0:6484:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789578847.509557:0:6484:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789578847.509560:0:6484:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789578847.509808:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789578847.509951:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789578847.509964:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789578847.509979:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789578847.509985:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789578847.509994:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789578847.510006:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789578847.510077:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789578847.510090:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789578847.510092:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789578847.510103:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789578847.510108:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789578847.510120:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789578847.510125:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789578847.510135:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789578847.510140:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789578847.510150:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789578847.510161:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789578847.510231:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789578847.510240:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:0.0:1789578847.510242:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789578847.510253:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789578847.510257:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789578847.510267:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789578847.510271:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:0.0:1789578847.510281:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789578847.510285:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789578847.510295:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789578847.510316:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789578847.511711:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789578847.511733:0:6484:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.137@tcp 20000000:01000000:1.0:1789578847.511735:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789578847.511747:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789578847.511752:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789578847.511762:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789578847.511767:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.137@tcp (null) (null) 00000040:00080000:1.0:1789578847.511777:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789578847.511785:0:6484:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789578847.511797:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789578847.511907:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789578847.511923:0:6484:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789578847.511926:0:6484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789578847.511930:0:6484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789578847.511970:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789578847.511973:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789578847.512524:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789578847.512545:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789578847.512558:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789578847.512727:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789578847.512744:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789578847.512755:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789578847.512762:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789578847.512764:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789578847.513126:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789578847.513151:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789578847.513162:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789578847.513578:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789578847.513599:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789578847.513613:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789578847.513631:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789578847.513633:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789578847.513991:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789578847.514153:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789578847.514175:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789578847.514187:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789578847.514195:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789578847.514196:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789578847.515572:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789578847.515608:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789578847.515625:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789578847.515921:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789578847.515946:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789578847.515958:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789578847.515970:0:6484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789578847.515972:0:6484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789578847.516302:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789578847.516323:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789578847.516544:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789578847.516699:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789578847.516719:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789578847.516734:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1789578847.516749:0:6484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789578847.516769:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516788:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a7a expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516795:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516801:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516807:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516894:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b29 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516913:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b45 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516919:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516926:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516962:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.516976:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.516991:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062016:0@lo:104: 00000100:00100000:1.0:1789578847.517048:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578847.517131:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.517139:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.517148:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062144:0@lo:104: 00000100:00100000:1.0:1789578847.517169:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578847.517318:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.517335:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 21 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.517370:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062272:0@lo:104: 00000100:00100000:1.0:1789578847.517396:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.517539:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062016 00000100:00100000:2.0:1789578847.517546:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062016 00000100:00100000:2.0:1789578847.517626:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062144 00000100:00100000:2.0:1789578847.517635:0:6474:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062144 00000100:00100000:0.0:1789578847.517686:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578847.517697:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062016:12345-0@lo:104: 00010000:00010000:0.0:1789578847.517711:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.517759:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789578847.517765:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062016:12345-0@lo:104: Request processed in 72us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.517772:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578847.517792:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789578847.517798:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277062144:12345-0@lo:104: 00010000:00010000:0.0:1789578847.517805:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.517849:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789578847.517854:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277062144:12345-0@lo:104: Request processed in 57us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.517860:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789578847.518022:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789578847.518029:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518036:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.518040:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518048:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578847.518055:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.518060:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.518088:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518094:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.518112:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518119:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400030200/0xd90373d592f20b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518131:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578847.518134:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518139:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.518148:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518155:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578847.518162:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.518167:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.518181:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518187:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.518193:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518199:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400031c00/0xd90373d592f20b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b4c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.518278:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.518280:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.518281:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578847.518305:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277062400:0@lo:103: 00010000:00010000:3.0:1789578847.518562:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578847.519252:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.519266:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.519277:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062656:0@lo:104: 00000100:00100000:1.0:1789578847.519337:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.519439:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277062528:0@lo:103: 00000100:00100000:3.0:1789578847.519476:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.520216:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.520275:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062528 00000100:00100000:2.0:1789578847.520282:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062528 00010000:00010000:2.0:1789578847.520316:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 22 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.520345:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062400 00000100:00100000:2.0:1789578847.520372:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062400 00010000:00010000:2.0:1789578847.520388:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 23 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.520403:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789578847.520410:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3618:x1876509277062528:12345-0@lo:103: 00010000:00010000:2.0:1789578847.520423:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578847.520429:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 23 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.520440:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 23 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.520457:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578847.520492:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3618:x1876509277062528:12345-0@lo:103: Request processed in 82us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.520498:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789578847.520516:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789578847.520522:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3617:x1876509277062400:12345-0@lo:103: 00010000:00010000:2.0:1789578847.520529:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578847.520533:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 22 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.520542:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 22 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.520551:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578847.520575:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3617:x1876509277062400:12345-0@lo:103: Request processed in 54us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.520580:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789578847.520623:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277062528:0@lo:103: 00000100:00100000:2.0:1789578847.520648:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277062400:0@lo:103: 00010000:00010000:1.0:1789578847.521177:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.521189:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 21 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521201:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062784:0@lo:104: 00000100:00100000:1.0:1789578847.521242:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.521323:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062272 00000100:00100000:0.0:1789578847.521478:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062272 00000100:00100000:0.0:1789578847.521513:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062656 00000100:00100000:0.0:1789578847.521516:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062656 00000100:00100000:0.0:1789578847.521535:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789578847.521542:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062272:12345-0@lo:104: 00010000:00010000:0.0:1789578847.521554:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.521596:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789578847.521607:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062272:12345-0@lo:104: Request processed in 66us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.521613:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789578847.521628:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789578847.521633:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277062656:12345-0@lo:104: 00010000:00010000:0.0:1789578847.521640:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.521671:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789578847.521676:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277062656:12345-0@lo:104: Request processed in 43us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.521682:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789578847.521696:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789578847.521704:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.521791:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.521800:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521820:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062912:0@lo:104: 00010000:00010000:3.0:1789578847.521833:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578847.521838:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.521848:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521855:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789578847.521863:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578847.521879:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789578847.521890:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.521909:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 21 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.521913:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521922:0:6484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277063040:0@lo:104: 00010000:00010000:3.0:1789578847.521923:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578847.521945:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521949:0:6484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100df180 going to sleep for 11 seconds 00010000:00010000:3.0:1789578847.521957:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b30 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.521969:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436400/0xd90373d592f20b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20b6f expref: 21 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.521971:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578847.521982:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.521983:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062016:0@lo:104: 00010000:00010000:3.0:1789578847.521995:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578847.522001:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.522002:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f400/0xd90373d592f20b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20b45 expref: 20 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.522020:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.522022:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062144:0@lo:104: 10000000:00010000:3.0:1789578847.522035:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.522037:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062272:0@lo:104: 10000000:01000000:3.0:1789578847.522048:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789578847.522050:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062656:0@lo:104: 00010000:00010000:3.0:1789578847.522068:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.522075:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578847.522081:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.522087:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687800/0xd90373d592f20aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b06 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.522096:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578847.522098:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578847.522099:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578847.522112:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063168:0@lo:103: 00000100:00100000:3.0:1789578847.522141:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.522175:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578847.522180:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789578847.522182:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063296:0@lo:103: 00000100:00100000:0.0:1789578847.522214:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.522222:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.522231:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062784 00000100:00100000:0.0:1789578847.522237:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062784 00000100:00100000:3.0:1789578847.522261:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063168 00000100:00100000:0.0:1789578847.522261:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277062912 00000100:00100000:3.0:1789578847.522267:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063168 00000100:00100000:0.0:1789578847.522267:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277062912 00000100:00100000:0.0:1789578847.522284:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063040 00000100:00100000:0.0:1789578847.522288:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063040 00010000:00010000:3.0:1789578847.522292:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 20 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578847.522306:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789578847.522314:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6484:x1876509277062784:12345-0@lo:104: 00000100:00100000:3.0:1789578847.522315:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063296 00000100:00100000:3.0:1789578847.522321:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063296 00010000:00010000:0.0:1789578847.522334:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.522335:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578847.522381:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789578847.522389:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3615:x1876509277063168:12345-0@lo:103: 00010000:00010000:0.0:1789578847.522420:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789578847.522427:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+5:6484:x1876509277062784:12345-0@lo:104: Request processed in 114us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.522434:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789578847.522456:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578847.522463:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302326450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062912:12345-0@lo:104: 00010000:00010000:0.0:1789578847.522471:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.522498:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789578847.522503:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302326450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6484:x1876509277062912:12345-0@lo:104: Request processed in 42us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.522509:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578847.522535:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578847.522540:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277063040:12345-0@lo:104: 00010000:00010000:0.0:1789578847.522548:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.522571:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789578847.522576:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6484:x1876509277063040:12345-0@lo:104: Request processed in 36us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.522582:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578847.522609:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062784:0@lo:104: 00000100:00100000:0.0:1789578847.522617:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277062912:0@lo:104: 00000100:00100000:0.0:1789578847.522624:0:6484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6484:1876509277063040:0@lo:104: 00010000:00010000:0.0:1789578847.522653:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.522905:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789578847.522913:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789578847.523232:0:6475:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789578847.523242:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789578847.523250:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3615:x1876509277063296:12345-0@lo:103: 00010000:00010000:0.0:1789578847.523265:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578847.523270:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.523280:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.523293:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687000/0xd90373d592f20b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20aff expref: 21 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.523306:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578847.523363:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3615:x1876509277063296:12345-0@lo:103: Request processed in 99us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.523370:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789578847.524391:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578847.524454:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.524468:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.524482:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687400/0xd90373d592f20b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20b29 expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.524494:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578847.524935:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3615:x1876509277063168:12345-0@lo:103: Request processed in 2546us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.524944:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789578847.524987:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789578847.524995:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525005:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.525010:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525020:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578847.525025:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063296:0@lo:103: 10000000:00010000:2.0:1789578847.525031:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.525038:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789578847.525039:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063168:0@lo:103: 00010000:00010000:3.0:1789578847.525077:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789578847.525110:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525117:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.525141:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525148:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aea expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525160:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578847.525164:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525181:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.525184:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525192:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578847.525199:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.525204:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.525619:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525627:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.525633:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525640:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400031200/0xd90373d592f20a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a81 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.525650:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.525652:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.525654:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578847.525666:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277063552:0@lo:103: 00000100:00100000:2.0:1789578847.525701:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.525767:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578847.525773:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277063424:0@lo:103: 00000100:00100000:2.0:1789578847.525802:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578847.526030:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578847.526040:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526049:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578847.526052:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526060:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578847.526067:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578847.526072:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789578847.526087:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063552 00000100:00100000:1.0:1789578847.526095:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063552 00010000:00010000:3.0:1789578847.526104:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526112:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578847.526126:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526126:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 18 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526148:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939400030800/0xd90373d592f20aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20aab expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.526166:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063424 00010000:00010000:3.0:1789578847.526168:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578847.526171:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063424 00010000:00010000:3.0:1789578847.526172:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578847.526176:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578847.526187:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578847.526188:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063680:0@lo:103: 00000100:00100000:1.0:1789578847.526226:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789578847.526231:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.526246:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3618:x1876509277063552:12345-0@lo:103: 00000100:00100000:3.0:1789578847.526266:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063680 00010000:00010000:1.0:1789578847.526268:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789578847.526272:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063680 00010000:00010000:1.0:1789578847.526277:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526288:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 20 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526292:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 20 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526308:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519a00/0xd90373d592f20a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20a7a expref: 20 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578847.526314:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789578847.526325:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3618:x1876509277063424:12345-0@lo:103: 00010000:00010000:3.0:1789578847.526334:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578847.526339:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 19 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526421:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578847.526455:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3618:x1876509277063552:12345-0@lo:103: Request processed in 214us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.526461:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789578847.526475:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789578847.526481:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3615:x1876509277063680:12345-0@lo:103: 00010000:00010000:1.0:1789578847.526489:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578847.526493:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 18 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526655:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 18 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526668:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c6a00/0xd90373d592f20aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20ae3 expref: 18 pid: 6485 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.526681:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578847.526791:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 17 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526803:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7400/0xd90373d592f20aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20aa4 expref: 17 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526889:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526907:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526920:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526927:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526933:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526939:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526944:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789578847.526947:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526954:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526973:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.526984:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578847.527012:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3615:x1876509277063680:12345-0@lo:103: Request processed in 531us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.527019:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789578847.527070:0:6484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.527078:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.527085:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e400/0xd90373d592f20b8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789578847.527098:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789578847.527464:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277063424:0@lo:103: 00000100:00100000:0.0:1789578847.527473:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277063552:0@lo:103: 00000100:00100000:3.0:1789578847.527646:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3618:x1876509277063424:12345-0@lo:103: Request processed in 1321us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.527654:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789578847.527683:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277063680:0@lo:103: 00010000:00010000:3.0:1789578847.527697:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578847.527700:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578847.535059:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+14:9481:x1876509277061888:12345-0@lo:253: Request processed in 25551us (25965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.535072:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789578847.535191:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277061888:0@lo:253: 10000000:01000000:1.0:1789578847.535474:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789578847.535479:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789578847.535480:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789578847.535482:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789578847.535483:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789578847.535484:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789578847.535485:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789578847.535487:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789578847.535489:0:9481:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789578847.535490:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789578847.535491:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789578847.535512:0:9481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939302b3c800 from lustre-OST0001 10000000:01000000:1.0:1789578847.535542:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789578847.535544:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789578847.535553:0:9481:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93941008b380 local copy 10000000:01000000:1.0:1789578847.535557:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789578847.535592:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.535603:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.535613:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.535631:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277063808:0@lo:101: 00000100:00100000:1.0:1789578847.535669:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.535936:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100df780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578847.535977:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063808 00000100:00100000:3.0:1789578847.535985:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063808 00000100:00100000:3.0:1789578847.536081:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789578847.536091:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+14:9481:x1876509277063808:12345-0@lo:101: 00010000:00010000:3.0:1789578847.536112:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578847.536127:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518a00/0xd90373d592f20b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20b92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.536151:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518a00/0xd90373d592f20b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20b92 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.536162:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518a00/0xd90373d592f20b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b92 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.536171:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:3.0:1789578847.536289:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277063808:12345-0@lo:101: Request processed in 199us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.536296:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789578847.536385:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277063808:0@lo:101: 00010000:00010000:1.0:1789578847.536399:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.536420:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.536520:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277063936:0@lo:501: 00000100:00100000:1.0:1789578847.536546:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.536725:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100df780 going to sleep for 11 seconds 00000100:00100000:2.0:1789578847.536760:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277063936 00000100:00100000:2.0:1789578847.536766:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277063936 00000100:00100000:2.0:1789578847.536789:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789578847.536795:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277063936:12345-0@lo:501: 00000100:00100000:1.0:1789578847.537454:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277063936:0@lo:501: 10000000:01000000:1.0:1789578847.537472:0:9481:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789578847.537490:0:9481:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789578847.537497:0:9481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.537507:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.537515:0:9481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.537534:0:9481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789578847.537565:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939302b3c800 10000000:01000000:1.0:1789578847.537569:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789578847.537574:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789578847.537577:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789578847.537582:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789578847.537584:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789578847.537605:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.537626:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.537636:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.537651:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064064:0@lo:101: 00000100:00100000:1.0:1789578847.537680:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.537697:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578847.537764:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277063936:12345-0@lo:501: Request processed in 512us (761us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789578847.537773:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789578847.537796:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064064 00000100:00100000:2.0:1789578847.537801:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064064 00000100:00100000:2.0:1789578847.537930:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789578847.537937:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064064:12345-0@lo:101: 00010000:00010000:2.0:1789578847.537946:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578847.537959:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20ba0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.537977:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.537986:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.537992:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789578847.538030:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064064:12345-0@lo:101: Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.538036:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1789578847.538059:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578847.538065:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.538085:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.538089:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.538097:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.538212:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064064:0@lo:101: 00010000:00010000:1.0:1789578847.538224:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.538232:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.538291:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064192:0@lo:501: 00000100:00100000:1.0:1789578847.538323:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.538522:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100dfc00 going to sleep for 11 seconds 10000000:00010000:2.0:1789578847.538594:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.538600:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.538620:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.538626:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.538644:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.538650:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2f400/0xd90373d592f20b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd90373d592f20b99 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.538663:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.538665:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.538666:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578847.538675:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277064320:0@lo:103: 00000100:00100000:2.0:1789578847.538699:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.538733:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064192 00000100:00100000:2.0:1789578847.538738:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064192 00000100:00100000:2.0:1789578847.538755:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789578847.538767:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064192:12345-0@lo:501: 00000100:00100000:2.0:1789578847.539004:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064192:12345-0@lo:501: Request processed in 236us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.539011:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789578847.539073:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064320 00000100:00100000:1.0:1789578847.539078:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064320 00000100:00100000:1.0:1789578847.539122:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578847.539130:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3616:x1876509277064320:12345-0@lo:103: 00010000:00010000:1.0:1789578847.539139:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578847.539152:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518a00/0xd90373d592f20b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20b92 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.539173:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578847.539199:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3616:x1876509277064320:12345-0@lo:103: Request processed in 71us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.539462:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789578847.539540:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277064320:0@lo:103: 00000100:00100000:0.0:1789578847.539609:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064192:0@lo:501: 00000100:00100000:0.0:1789578847.539645:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064448:0@lo:503: 00000100:00100000:0.0:1789578847.539688:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.539720:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.539771:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064448 00000100:00100000:1.0:1789578847.539776:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064448 00000100:00100000:1.0:1789578847.539817:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789578847.539825:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064448:12345-0@lo:503: 00000100:00100000:1.0:1789578847.539921:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064448:12345-0@lo:503: Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.539928:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789578847.540067:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064448:0@lo:503: 00000040:00080000:0.0:1789578847.540576:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789578847.540657:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064576:0@lo:502: 00000100:00100000:0.0:1789578847.540694:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.540714:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.540779:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064576 00000100:00100000:1.0:1789578847.540784:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064576 00000100:00100000:1.0:1789578847.540805:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789578847.540824:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064576:12345-0@lo:502: 00000100:00100000:1.0:1789578847.540921:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064576:12345-0@lo:502: Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.540928:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789578847.541068:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064576:0@lo:502: 00000040:00080000:0.0:1789578847.541265:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789578847.541290:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789578847.541305:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789578847.541562:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789578847.541582:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789578847.541595:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789578847.541618:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064704:0@lo:502: 00000100:00100000:0.0:1789578847.541654:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.541681:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.541753:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064704 00000100:00100000:1.0:1789578847.541758:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064704 00000100:00100000:1.0:1789578847.541779:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789578847.541785:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064704:12345-0@lo:502: 00000100:00100000:1.0:1789578847.541968:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064704:12345-0@lo:502: Request processed in 182us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.541976:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789578847.542050:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064704:0@lo:502: 00000040:00080000:0.0:1789578847.542087:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789578847.542095:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789578847.542764:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789578847.542773:0:9494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789578847.542779:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.542782:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789578847.542787:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789578847.542824:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff939303574d40) 00000020:00000080:0.0:1789578847.542847:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789578847.542854:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789578847.542936:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939302b3c800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789578847.542946:0:9494:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789578847.542953:0:9494:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f20bb5 00010000:00010000:1.0:1789578847.549748:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789578847.550196:0:9494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789578847.558059:0:9494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789578847.558638:0:9494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789578847.565004:0:9494:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789578847.565274:0:9494:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789578847.574904:0:9494:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789578847.576604:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789578847.576618:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578847.576625:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.576627:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789578847.576631:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578847.576635:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.576636:0:9494:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789578847.576640:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789578847.576642:0:9494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789578847.576663:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578847.576666:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.576667:0:9494:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789578847.576671:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789578847.576823:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789578847.576854:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789578847.576879:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.576892:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578847.576900:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939302b3c800 from 1 10000000:01000000:1.0:1789578847.576902:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789578847.576936:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.576944:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.576954:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.576976:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064832:0@lo:101: 00000100:00100000:1.0:1789578847.577043:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.577085:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.577117:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064832 00000100:00100000:1.0:1789578847.577124:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064832 00000100:00100000:1.0:1789578847.577165:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789578847.577173:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:9481:x1876509277064832:12345-0@lo:101: 00010000:00010000:1.0:1789578847.577187:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578847.577205:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20bbc expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.577227:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20bbc expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.577238:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20bbc expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.577246:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2fa00, rc 0) 00000100:00100000:1.0:1789578847.577283:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064832:12345-0@lo:101: Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.577290:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789578847.577344:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064832:0@lo:101: 00010000:00010000:1.0:1789578847.577379:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.577388:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578847.577728:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064960:0@lo:501: 00000100:00100000:1.0:1789578847.577753:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578847.577784:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95300 going to sleep for 11 seconds 00000100:00100000:0.0:1789578847.579220:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277064960 00000100:00100000:0.0:1789578847.579230:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277064960 00000100:00100000:0.0:1789578847.579266:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789578847.579275:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064960:12345-0@lo:501: 00000100:00100000:0.0:1789578847.579554:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277064960:12345-0@lo:501: Request processed in 279us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.579561:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789578847.579607:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277064960:0@lo:501: 00000100:00100000:0.0:1789578847.579648:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065088:0@lo:503: 00000100:00100000:0.0:1789578847.579697:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.579722:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578847.579736:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065088 00000100:00100000:0.0:1789578847.579741:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065088 00000100:00100000:0.0:1789578847.579758:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789578847.579763:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065088:12345-0@lo:503: 00000100:00100000:0.0:1789578847.580201:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065088:12345-0@lo:503: Request processed in 436us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.580208:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789578847.580249:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065088:0@lo:503: 00000040:00080000:0.0:1789578847.580748:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789578847.584244:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065216:0@lo:502: 00000100:00100000:0.0:1789578847.584324:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.584391:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578847.584738:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065216 00000100:00100000:3.0:1789578847.584747:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065216 00000100:00100000:3.0:1789578847.584799:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789578847.584818:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065216:12345-0@lo:502: 00000100:00100000:3.0:1789578847.584955:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065216:12345-0@lo:502: Request processed in 149us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.584963:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789578847.585019:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437206300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065216:0@lo:502: 00000040:00080000:3.0:1789578847.585268:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789578847.585299:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789578847.585339:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065344:0@lo:502: 00000100:00100000:3.0:1789578847.585612:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.589539:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277065472:0@lo:13: 00000100:00100000:3.0:1789578847.589604:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.589636:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578847.589641:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277065600:0@lo:13: 00000100:00100000:3.0:1789578847.589662:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.589691:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065472 00000100:00100000:3.0:1789578847.589699:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065472 00000100:00100000:3.0:1789578847.589741:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065600 00000100:00100000:3.0:1789578847.589744:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065600 00000100:00100000:3.0:1789578847.589760:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789578847.589767:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277065472:12345-0@lo:13: 00002000:00000024:3.0:1789578847.589795:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578847.590462:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065344 00000100:00100000:1.0:1789578847.590470:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065344 00000100:00100000:1.0:1789578847.590508:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789578847.590515:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065344:12345-0@lo:502: 00000100:00100000:1.0:1789578847.590638:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065344:12345-0@lo:502: Request processed in 123us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.590654:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789578847.591515:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277065472:12345-0@lo:13: Request processed in 1745us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.591524:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789578847.591544:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578847.591552:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277065600:12345-0@lo:13: 00002000:00000024:3.0:1789578847.591567:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578847.591595:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277065600:12345-0@lo:13: Request processed in 45us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.591601:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789578847.591645:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930350e300 x1876509277065600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.591665:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277065600:0@lo:13: 00010000:00080000:3.0:1789578847.591680:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930350df80 x1876509277065472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.591690:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277065472:0@lo:13: 00000100:00100000:3.0:1789578847.591755:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789578847.591771:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065344:0@lo:502: 00000040:00080000:3.0:1789578847.592622:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789578847.592640:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789578847.598381:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578847.598523:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.598526:0:9499:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789578847.598534:0:9499:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939302b3c800 00000020:00000080:0.0:1789578847.598537:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789578847.598563:0:9499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578847.598566:0:9499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578847.598568:0:9499:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789578847.598571:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789578847.598692:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789578847.598722:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578847.598744:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.598756:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.598817:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789578847.598820:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939302b3c800 10000000:01000000:2.0:1789578847.598824:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939302b3c800 10000000:01000000:2.0:1789578847.598829:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789578847.598834:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff939302b3c800 from 1 10000000:01000000:2.0:1789578847.598837:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789578847.598887:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.598896:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.598907:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.598930:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065728:0@lo:101: 00000100:00100000:2.0:1789578847.599004:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.599037:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.599250:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065728 00000100:00100000:1.0:1789578847.599257:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065728 00000100:00100000:1.0:1789578847.599297:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789578847.599305:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:9481:x1876509277065728:12345-0@lo:101: 00010000:00010000:1.0:1789578847.599317:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578847.599329:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20bca expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.599371:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20bca expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.599381:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20bca expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578847.599388:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ec00, rc 0) 00000100:00100000:1.0:1789578847.600587:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277065728:12345-0@lo:101: Request processed in 1277us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.600596:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789578847.604473:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065728:0@lo:101: 00010000:00010000:0.0:1789578847.604501:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.604513:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578847.604634:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065856:0@lo:501: 00000100:00100000:0.0:1789578847.604695:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.604737:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.605088:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065856 00000100:00100000:1.0:1789578847.605095:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065856 00000100:00100000:1.0:1789578847.605214:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789578847.605224:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277065856:12345-0@lo:501: 00000100:00100000:1.0:1789578847.605791:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277065856:12345-0@lo:501: Request processed in 568us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.605800:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789578847.605955:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065856:0@lo:501: 00000100:00100000:0.0:1789578847.605991:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065984:0@lo:503: 00000100:00100000:0.0:1789578847.606038:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.606093:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789578847.606197:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277065984 00000100:00100000:2.0:1789578847.606202:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277065984 00000100:00100000:2.0:1789578847.606235:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789578847.606242:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277065984:12345-0@lo:503: 00000100:00100000:2.0:1789578847.606741:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277065984:12345-0@lo:503: Request processed in 499us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.606749:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789578847.606886:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277065984:0@lo:503: 00000040:00080000:0.0:1789578847.607191:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789578847.607276:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066112:0@lo:502: 00000100:00100000:0.0:1789578847.607641:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.607707:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.607742:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066112 00000100:00100000:1.0:1789578847.607749:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066112 00000100:00100000:1.0:1789578847.607830:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789578847.607839:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066112:12345-0@lo:502: 00000100:00100000:1.0:1789578847.607957:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066112:12345-0@lo:502: Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.607964:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789578847.608035:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066112:0@lo:502: 00000040:00080000:0.0:1789578847.608241:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789578847.608269:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789578847.608283:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789578847.608295:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789578847.608308:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789578847.608337:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789578847.608386:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789578847.608411:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789578847.608427:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789578847.608439:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789578847.608450:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789578847.608463:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789578847.608476:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789578847.608498:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789578847.608513:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789578847.608536:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789578847.608548:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789578847.608560:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789578847.608573:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789578847.608587:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789578847.608600:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789578847.608613:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789578847.608626:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789578847.608638:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789578847.608650:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789578847.608661:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789578847.608670:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789578847.608680:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789578847.608691:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789578847.608703:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789578847.608717:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789578847.608741:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789578847.608754:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789578847.608764:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789578847.608776:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789578847.608788:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789578847.608800:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789578847.608811:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789578847.608822:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789578847.608833:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789578847.608844:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789578847.608854:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789578847.608865:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789578847.608890:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789578847.608902:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789578847.608915:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789578847.608953:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066240:0@lo:502: 00000100:00100000:0.0:1789578847.608999:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.609860:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408e3d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578847.609984:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066240 00000100:00100000:3.0:1789578847.609993:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066240 00000100:00100000:3.0:1789578847.610031:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789578847.610040:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066240:12345-0@lo:502: 00000100:00100000:3.0:1789578847.610186:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066240:12345-0@lo:502: Request processed in 147us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.610193:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789578847.610338:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066240:0@lo:502: 00000040:00080000:0.0:1789578847.610608:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789578847.610622:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789578847.611674:0:9500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789578847.611690:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff939303570000) 00000020:00000080:0.0:1789578847.611712:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789578847.611805:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939302b3c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789578847.611820:0:9500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939302b3c800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789578847.611823:0:9500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939302b3c800 3 00010000:00080000:0.0:1789578847.611853:0:9500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93930232d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789578847.617281:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789578847.617789:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789578847.617844:0:9500:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789578847.617856:0:9500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd90373d592f20bdf 00000100:00080000:0.0:1789578847.617866:0:9500:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789578847.617886:0:9500:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93930232d000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578847.617922:0:9500:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939437205180 x1876509277066368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789578847.617947:0:9500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789578847.618556:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277066368:0@lo:38: 00000100:00100000:2.0:1789578847.618623:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.618733:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066368 00000100:00100000:0.0:1789578847.618740:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066368 00000100:00100000:0.0:1789578847.618768:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789578847.618775:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277066368:12345-0@lo:38: 00010000:00080000:0.0:1789578847.618798:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789578847.618912:0:6492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd90373d592f20be6 00000004:00100000:0.0:1789578847.618931:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789578847.618969:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9393038d3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578847.619018:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876509277066368:12345-0@lo:38: Request processed in 242us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.619025:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789578847.619958:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437205180 x1876509277066368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578847.619970:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789578847.619979:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789578847.619987:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789578847.619991:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789578847.619994:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789578847.620001:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277066368:0@lo:38: 00000020:01000004:2.0:1789578847.621009:0:9500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789578847.621026:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93942e1519c0) 00000020:00000080:2.0:1789578847.621049:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1789578847.621233:0:9501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9501:1876509277066496:0@lo:901: 00000100:00100000:0.0:1789578847.621298:0:9501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.621371:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066496 00000100:00100000:0.0:1789578847.621377:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066496 00000100:00100000:0.0:1789578847.621550:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789578847.621559:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9501:x1876509277066496:12345-0@lo:901: 00000100:00100000:0.0:1789578847.621647:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9501:x1876509277066496:12345-0@lo:901: Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578847.621654:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789578847.621679:0:9501:0:(client.c:2716:ptlrpc_set_wait()) set ffff939429192840 going to sleep for 11 seconds 00010000:00080000:0.0:1789578847.621699:0:9501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939437205180 x1876509277066496/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789578863 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578847.621712:0:9501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9501:1876509277066496:0@lo:901: 00000100:00080000:2.0:1789578847.621956:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:2.0:1789578847.621996:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939302b3c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789578847.622000:0:9500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939302b3c800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789578847.622004:0:9500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939302b3c800 3 00010000:00080000:2.0:1789578847.622032:0:9500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9394370cc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789578847.625199:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789578847.627576:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789578847.627987:0:9500:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789578847.628003:0:9500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd90373d592f20bf4 00000100:00080000:3.0:1789578847.628016:0:9500:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789578847.628029:0:9500:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9394370cc800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789578847.628069:0:9500:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93943738a680 x1876509277066624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789578847.628087:0:9500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789578847.628247:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277066624:0@lo:38: 00000100:00100000:2.0:1789578847.628524:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789578847.629412:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:3.0:1789578847.632937:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066624 00000100:00100000:3.0:1789578847.632951:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066624 00000100:00100000:3.0:1789578847.632996:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789578847.633004:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277066624:12345-0@lo:38: 00010000:00080000:3.0:1789578847.633033:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1789578847.633069:0:6491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd90373d592f20bfb 00000004:00100000:3.0:1789578847.633085:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789578847.633290:0:6491:0:(import.c:65:import_set_state_nolock()) ffff939441aa0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578847.633417:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876509277066624:12345-0@lo:38: Request processed in 411us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578847.633424:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789578847.633475:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93943738a680 x1876509277066624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789578857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578847.633486:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789578847.633494:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789578847.633501:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789578847.633506:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789578847.633508:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394370cc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789578847.633513:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277066624:0@lo:38: 00000020:01000000:3.0:1789578847.633548:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789578847.633581:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789578847.633596:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578847.633606:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789578847.633667:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789578847.633670:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789578847.633671:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578847.633672:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578847.633674:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578847.633675:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578847.633677:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578847.633679:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578847.633680:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578847.633682:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578847.633684:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789578847.633688:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789578847.633693:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789578847.633695:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789578847.633696:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578847.633697:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578847.633698:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578847.633699:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578847.633700:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578847.633701:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578847.633701:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578847.633702:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578847.633703:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789578847.633720:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789578847.633733:0:9481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066752:0@lo:253: 00000100:00100000:3.0:1789578847.633776:0:9481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578847.633802:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066752 00000100:00100000:3.0:1789578847.633806:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066752 00000100:00100000:3.0:1789578847.633848:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789578847.633855:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066752:12345-0@lo:253: 20000000:01000000:3.0:1789578847.633884:0:6482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789578847.633897:0:6482:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789578847.634021:0:9481:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407daa240 going to sleep for 11 seconds 20000000:01000000:2.0:1789578847.644528:0:6482:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789578847.644572:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789578847.644936:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:9481:x1876509277066752:12345-0@lo:253: Request processed in 11077us (11155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.644948:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789578847.645115:0:9481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42b2619d-9ae6-4775-a880-4d874c1635bc:9481:1876509277066752:0@lo:253: 10000000:01000000:3.0:1789578847.645131:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789578847.645134:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789578847.645137:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789578847.645138:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789578847.645139:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789578847.645141:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789578847.645142:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789578847.645144:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789578847.645145:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789578847.645146:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789578847.645148:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789578847.645149:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789578847.645162:0:9481:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789578847.649011:0:6506:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789578847.649019:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789578847.649043:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.649061:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.649069:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.649094:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.649534:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.649553:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578847.649567:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277066880:0@lo:104: 00000100:00100000:0.0:1789578847.649630:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789578847.650455:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578847.650468:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578847.650479:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277067008:0@lo:104: 00000100:00100000:0.0:1789578847.650508:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578847.650994:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578847.651030:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277066880 00000100:00100000:1.0:1789578847.651037:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277066880 00000100:00100000:1.0:1789578847.651149:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067008 00000100:00100000:1.0:1789578847.651153:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067008 00000100:00100000:1.0:1789578847.651178:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789578847.651187:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789578847.651187:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277066880:12345-0@lo:104: 00000100:00100000:2.0:1789578847.651194:0:6474:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277067008:12345-0@lo:104: 00010000:00010000:1.0:1789578847.651200:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651201:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651258:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789578847.651265:0:6474:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+4:6506:x1876509277067008:12345-0@lo:104: Request processed in 72us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.651272:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789578847.651296:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578847.651303:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651322:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.651326:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651334:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578847.651372:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.651377:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.651422:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651428:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.651445:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651450:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c7c00/0xd90373d592f20af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20af8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651461:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.651463:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.651465:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578847.651476:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277067136:0@lo:103: 00000100:00100000:2.0:1789578847.651504:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.651539:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067136 00000100:00100000:2.0:1789578847.651543:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067136 00010000:00010000:2.0:1789578847.651559:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 17 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.651578:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789578847.651584:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3615:x1876509277067136:12345-0@lo:103: 00010000:00010000:2.0:1789578847.651593:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578847.651597:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 17 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651612:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 17 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.651627:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578847.651654:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3615:x1876509277067136:12345-0@lo:103: Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.651660:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789578847.651694:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277067136:0@lo:103: 00010000:00010000:2.0:1789578847.651721:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519800/0xd90373d592f20af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20af1 expref: 16 pid: 6484 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.651731:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277067008:0@lo:104: 00010000:00010000:1.0:1789578847.651758:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789578847.651763:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6506:1876509277066880:0@lo:104: 00000100:00100000:1.0:1789578847.651764:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:6506:x1876509277066880:12345-0@lo:104: Request processed in 579us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578847.651770:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789578847.651779:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.653441:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578847.653453:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.653462:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578847.653466:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.653483:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578847.653491:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578847.653511:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789578847.653556:0:9493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.653563:0:9493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578847.653580:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.653588:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519e00/0xd90373d592f20b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20b3e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.653617:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277067264:0@lo:103: 00000100:00100000:2.0:1789578847.653667:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578847.654215:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067264 00000100:00100000:2.0:1789578847.654223:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067264 00010000:00010000:2.0:1789578847.654248:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578847.654323:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789578847.654333:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3616:x1876509277067264:12345-0@lo:103: 00010000:00010000:2.0:1789578847.654346:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578847.654536:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654549:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654564:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031400/0xd90373d592f20b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20b37 expref: 16 pid: 6482 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654583:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654592:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789578847.654607:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012005865s 00010000:00010000:2.0:1789578847.654612:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654618:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654624:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654631:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654636:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789578847.654640:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654648:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654662:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.654673:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578847.654717:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3616:x1876509277067264:12345-0@lo:103: Request processed in 386us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578847.654725:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00080000:10000000:3.0:1789578847.655651:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789578847.656143:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789578847.656743:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:2.0:1789578847.657545:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277067264:0@lo:103: 00010000:00010000:2.0:1789578847.657577:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.657588:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578847.657595:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437600/0xd90373d592f20c02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789578847.657635:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:2.0:1789578847.657686:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.657690:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578847.657691:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789578847.658095:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789578847.658330:0:9481:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789578847.661212:0:9481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789578847.671748:0:9481:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789578847.671759:0:9481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789578847.672017:0:9481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789578847.672054:0:9481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789578847.672074:0:9481:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789578847.672543:0:9481:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789578847.673445:0:9481:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578847.673659:0:9481:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789578848.356702:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578848.611644:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277067392:0@lo:41: 00000100:00100000:3.0:1789578848.611724:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578848.611897:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067392 00000100:00100000:1.0:1789578848.611905:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067392 00000100:00100000:1.0:1789578848.611950:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578848.611960:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277067392:12345-0@lo:41: 00000004:00000024:1.0:1789578848.611993:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789578848.612051:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277067392:12345-0@lo:41: Request processed in 92us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578848.612058:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789578848.613118:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277067392:0@lo:41: 00000100:00100000:3.0:1789578848.613138:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578848.613518:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277067520:0@lo:41: 00000100:00100000:3.0:1789578848.613563:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578848.613606:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067520 00000100:00100000:3.0:1789578848.613612:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067520 00000100:00100000:3.0:1789578848.613647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789578848.613735:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277067520:12345-0@lo:41: 00000004:00000024:3.0:1789578848.613762:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789578848.613800:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277067520:12345-0@lo:41: Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578848.613807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789578848.613855:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277067520:0@lo:41: 00000020:00000004:3.0:1789578848.651577:0:9557:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578848.651992:0:9557:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789578849.379745:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578850.407224:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578851.431199:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578852.451467:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578852.710659:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277067648:0@lo:13: 00000100:00100000:0.0:1789578852.710741:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578852.711135:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067648 00000100:00100000:3.0:1789578852.711143:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067648 00000100:00100000:3.0:1789578852.711202:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578852.711212:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277067648:12345-0@lo:13: 00002000:00000024:3.0:1789578852.711240:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578852.711291:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277067648:12345-0@lo:13: Request processed in 81us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578852.711298:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578852.711334:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277067904:0@lo:400: 00000100:00100000:3.0:1789578852.711385:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789578852.711393:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578852.711411:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277068416:0@lo:400: 00000100:00100000:3.0:1789578852.712796:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578852.712851:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277068928:0@lo:400: 00000100:00100000:3.0:1789578852.712884:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578852.712912:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789578852.712920:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277068032:0@lo:400: 00000100:00100000:3.0:1789578852.712943:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578852.712960:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277068544:0@lo:400: 00000100:00100000:3.0:1789578852.712985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578852.712996:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277069056:0@lo:13: 00000100:00100000:3.0:1789578852.713017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.713053:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067904 00000100:00100000:3.0:1789578852.713055:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069056 00000100:00100000:3.0:1789578852.713062:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069056 00000100:00100000:0.0:1789578852.713062:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067904 00000100:00100000:0.0:1789578852.713103:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068416 00000100:00100000:0.0:1789578852.713108:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068416 00000100:00100000:3.0:1789578852.713118:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789578852.713137:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068928 00000100:00100000:3.0:1789578852.713140:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277069056:12345-0@lo:13: 00000100:00100000:0.0:1789578852.713142:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068928 00000100:00100000:0.0:1789578852.713160:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068544 00000100:00100000:0.0:1789578852.713164:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068544 00002000:00000024:3.0:1789578852.713167:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578852.713183:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789578852.713192:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277067904:12345-0@lo:400: 00000100:00100000:3.0:1789578852.713211:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277069056:12345-0@lo:13: Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578852.713219:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789578852.713238:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277067904:12345-0@lo:400: Request processed in 47us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578852.713244:0:6490:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.713246:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789578852.713254:0:6490:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789578852.713266:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789578852.713272:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.713274:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277068416:12345-0@lo:400: 00000100:00100000:3.0:1789578852.713283:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789578852.713292:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277068928:12345-0@lo:400: 00000100:00100000:0.0:1789578852.713309:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277068416:12345-0@lo:400: Request processed in 35us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.713316:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789578852.713328:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.713335:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789578852.713341:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277068544:12345-0@lo:400: 00000100:00100000:0.0:1789578852.713393:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277068544:12345-0@lo:400: Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.713399:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789578852.713487:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578852.713490:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578852.713492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578852.714520:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068032 00000100:00100000:0.0:1789578852.714634:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068032 00000100:00100000:0.0:1789578852.714678:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789578852.714686:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277068032:12345-0@lo:400: 00000100:00100000:0.0:1789578852.714743:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277068032:12345-0@lo:400: Request processed in 58us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.714758:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789578852.714786:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277067776:0@lo:400: 00000100:00100000:0.0:1789578852.714823:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.714931:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277068288:0@lo:400: 00000100:00100000:0.0:1789578852.714958:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.714977:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277068800:0@lo:400: 00000100:00100000:0.0:1789578852.714999:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.715095:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789578852.715102:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277068160:0@lo:400: 00000100:00100000:0.0:1789578852.715127:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.715140:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277068672:0@lo:400: 00000100:00100000:0.0:1789578852.715162:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578852.715188:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.715195:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068800 00000100:00100000:0.0:1789578852.715199:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068800 00000100:00100000:0.0:1789578852.715225:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.715230:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068160 00000100:00100000:0.0:1789578852.715233:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068160 00000100:00100000:0.0:1789578852.715243:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.715250:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789578852.715256:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277068800:12345-0@lo:400: 00000100:00100000:0.0:1789578852.715288:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277068800:12345-0@lo:400: Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.715293:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789578852.715303:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789578852.715309:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789578852.715315:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277068160:12345-0@lo:400: 00000100:00100000:0.0:1789578852.715371:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277068160:12345-0@lo:400: Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.715377:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789578852.715393:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578852.715429:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068288 00000100:00100000:0.0:1789578852.715433:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068288 00000100:00100000:0.0:1789578852.715449:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789578852.715454:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277068288:12345-0@lo:400: 00000100:00100000:0.0:1789578852.715482:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277068288:12345-0@lo:400: Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578852.715487:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789578852.715522:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40d500 x1876509277067648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.716314:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277067648:0@lo:13: 00010000:00080000:0.0:1789578852.716471:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943738b100 x1876509277068160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.716482:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277068160:0@lo:400: 00000100:00100000:0.0:1789578852.716494:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277068288:0@lo:400: 00010000:00080000:0.0:1789578852.716502:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16300 x1876509277068800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.716510:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277068800:0@lo:400: 00000100:00100000:2.0:1789578852.716632:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277067776 00000100:00100000:2.0:1789578852.716638:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277067776 00000100:00100000:2.0:1789578852.716692:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789578852.716701:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3616:x1876509277067776:12345-0@lo:400: 00000100:00100000:2.0:1789578852.716760:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3616:x1876509277067776:12345-0@lo:400: Request processed in 60us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578852.716779:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789578852.716811:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277068672 00000100:00100000:2.0:1789578852.716814:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277068672 00000100:00100000:2.0:1789578852.716849:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789578852.716856:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277068672:12345-0@lo:400: 00000100:00100000:2.0:1789578852.716898:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277068672:12345-0@lo:400: Request processed in 42us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578852.716904:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789578852.716929:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15f80 x1876509277068672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578852.716938:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277068672:0@lo:400: 00000100:00100000:2.0:1789578852.716947:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277067776:0@lo:400: 00000100:00100000:3.0:1789578852.717824:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277068928:12345-0@lo:400: Request processed in 4529us (4934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578852.717848:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789578852.717876:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277068032:0@lo:400: 00010000:00080000:0.0:1789578852.717893:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437388380 x1876509277068544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.717916:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277068544:0@lo:400: 00010000:00080000:0.0:1789578852.717932:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350d880 x1876509277069056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.717946:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277069056:0@lo:13: 00010000:00080000:0.0:1789578852.717959:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437389f80 x1876509277067904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.717967:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277067904:0@lo:400: 00010000:00080000:0.0:1789578852.717977:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437389880 x1876509277068416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.717985:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277068416:0@lo:400: 00010000:00080000:0.0:1789578852.717999:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17100 x1876509277068928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578852.718005:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277068928:0@lo:400: 00000001:02000400:0.0:1789578853.370154:0:9847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789578853.475496:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578853.732605:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277069184:0@lo:41: 00000100:00100000:2.0:1789578853.732801:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578853.733310:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069184 00000100:00100000:0.0:1789578853.733424:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069184 00000100:00100000:0.0:1789578853.733596:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789578853.733605:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277069184:12345-0@lo:41: 00000004:00000024:0.0:1789578853.733658:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789578853.736594:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277069312:0@lo:41: 00000100:00100000:2.0:1789578853.741364:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578853.743839:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789578853.743868:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789578853.745065:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069312 00000100:00100000:2.0:1789578853.745083:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069312 00000100:00100000:3.0:1789578853.745297:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789578853.745309:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277069312:12345-0@lo:41: 00000004:00000024:3.0:1789578853.745415:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789578853.745538:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277069312:12345-0@lo:41: Request processed in 231us (4194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578853.745546:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789578853.745684:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277069312:0@lo:41: 00000100:00100000:0.0:1789578853.746317:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277069184:12345-0@lo:41: Request processed in 12702us (13505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578853.746332:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789578853.746406:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277069184:0@lo:41: 00000020:00000004:0.0:1789578854.319919:0:9900:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578854.320187:0:9900:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789578854.502026:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578855.523603:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578856.549707:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789578857.164106:0:10002:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578857.164381:0:10002:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789578857.325498:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578857.325510:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93943711c800 from 39 10000000:01000000:3.0:1789578857.325517:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578857.325573:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.325587:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.325610:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.325641:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069440:0@lo:101: 00000100:00100000:3.0:1789578857.325735:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.325809:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.325938:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069440 00000100:00100000:2.0:1789578857.325948:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069440 00000100:00100000:2.0:1789578857.326022:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789578857.326034:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277069440:12345-0@lo:101: 00010000:00010000:2.0:1789578857.326051:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578857.326068:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c09 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.326099:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c09 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.326126:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c09 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.326137:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af600, rc 0) 00000100:00100000:2.0:1789578857.326191:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277069440:12345-0@lo:101: Request processed in 158us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.326197:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789578857.326250:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069440:0@lo:101: 00010000:00010000:2.0:1789578857.326266:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.326276:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.326389:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069568:0@lo:501: 00000100:00100000:2.0:1789578857.326416:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.326437:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.326453:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069568 00000100:00100000:2.0:1789578857.326456:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069568 00000100:00100000:2.0:1789578857.326480:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789578857.326487:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277069568:12345-0@lo:501: 00000100:00100000:2.0:1789578857.326629:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277069568:12345-0@lo:501: Request processed in 140us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.326636:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789578857.326666:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069568:0@lo:501: 00000100:00100000:2.0:1789578857.326692:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069696:0@lo:503: 00000100:00100000:2.0:1789578857.326742:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.326756:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.326767:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069696 00000100:00100000:2.0:1789578857.326771:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069696 00000100:00100000:2.0:1789578857.326792:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789578857.326809:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277069696:12345-0@lo:503: 00000100:00100000:2.0:1789578857.326906:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277069696:12345-0@lo:503: Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.326912:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789578857.326951:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277069696:0@lo:503: 00000100:00100000:2.0:1789578857.327176:0:10010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10010:1876509277069824:0@lo:502: 00000100:00100000:2.0:1789578857.327212:0:10010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.327229:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069824 00000100:00100000:2.0:1789578857.327233:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069824 00000100:00100000:2.0:1789578857.327255:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789578857.327261:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10010:x1876509277069824:12345-0@lo:502: 00000100:00100000:2.0:1789578857.327339:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10010:x1876509277069824:12345-0@lo:502: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.327346:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789578857.327411:0:10010:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.327422:0:10010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10010:1876509277069824:0@lo:502: 00000100:00100000:2.0:1789578857.327461:0:10010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10010:1876509277069952:0@lo:502: 00000100:00100000:2.0:1789578857.327493:0:10010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.327511:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277069952 00000100:00100000:2.0:1789578857.327515:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277069952 00000100:00100000:2.0:1789578857.327536:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789578857.327548:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10010:x1876509277069952:12345-0@lo:502: 00000100:00100000:2.0:1789578857.327606:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10010:x1876509277069952:12345-0@lo:502: Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.327612:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789578857.327644:0:10010:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.327657:0:10010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10010:1876509277069952:0@lo:502: 00000040:00080000:2.0:1789578857.327676:0:10010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789578857.327747:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789578857.327769:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789578857.327778:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.327790:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578857.327812:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789578857.327815:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789578857.327818:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789578857.327844:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.327852:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.327862:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.327875:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070080:0@lo:101: 00000100:00100000:2.0:1789578857.327902:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.327924:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.327938:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070080 00000100:00100000:2.0:1789578857.327942:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070080 00000100:00100000:2.0:1789578857.327962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789578857.327968:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277070080:12345-0@lo:101: 00010000:00010000:2.0:1789578857.327977:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578857.327990:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c17 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.328012:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c17 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.328022:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c17 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.328031:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:2.0:1789578857.328058:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070080:12345-0@lo:101: Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.328064:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789578857.328094:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070080:0@lo:101: 00010000:00010000:2.0:1789578857.328107:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.328117:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.328157:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070208:0@lo:501: 00000100:00100000:2.0:1789578857.328179:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.328191:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.328208:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070208 00000100:00100000:2.0:1789578857.328212:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070208 00000100:00100000:2.0:1789578857.328233:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789578857.328239:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070208:12345-0@lo:501: 00000100:00100000:2.0:1789578857.328341:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070208:12345-0@lo:501: Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.328376:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789578857.328409:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070208:0@lo:501: 00000100:00100000:2.0:1789578857.328435:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070336:0@lo:503: 00000100:00100000:2.0:1789578857.328473:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.328486:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.328497:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070336 00000100:00100000:2.0:1789578857.328501:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070336 00000100:00100000:2.0:1789578857.328522:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789578857.328527:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070336:12345-0@lo:503: 00000100:00100000:2.0:1789578857.328604:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070336:12345-0@lo:503: Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.328610:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789578857.328648:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070336:0@lo:503: 00000100:00100000:2.0:1789578857.338482:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10011:1876509277070464:0@lo:502: 00000100:00100000:2.0:1789578857.338604:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.338659:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.338789:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070464 00000100:00100000:1.0:1789578857.338815:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070464 00000100:00100000:1.0:1789578857.338882:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789578857.338894:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10011:x1876509277070464:12345-0@lo:502: 00000100:00100000:1.0:1789578857.339066:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10011:x1876509277070464:12345-0@lo:502: Request processed in 174us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.339074:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789578857.342861:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10011:1876509277070464:0@lo:502: 00000020:01000000:2.0:1789578857.342936:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578857.342953:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578857.342956:0:10011:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789578857.342976:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789578857.342979:0:10011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789578857.343030:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10011:1876509277070592:0@lo:502: 00000100:00100000:2.0:1789578857.343131:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.343432:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.360039:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070592 00000100:00100000:1.0:1789578857.360054:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070592 00000100:00100000:0.0:1789578857.360195:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789578857.360217:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10011:x1876509277070592:12345-0@lo:502: 00000100:00100000:0.0:1789578857.360519:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10011:x1876509277070592:12345-0@lo:502: Request processed in 314us (17388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.360528:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789578857.360623:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10011:1876509277070592:0@lo:502: 00000020:01000000:0.0:1789578857.360667:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578857.360676:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578857.360679:0:10011:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789578857.360685:0:10011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789578857.361239:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789578857.361267:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789578857.361281:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.361293:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578857.361305:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578857.361309:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940f42d800 from 39 10000000:01000000:3.0:1789578857.361312:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578857.361391:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.361400:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.361411:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.361437:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070720:0@lo:101: 00000100:00100000:3.0:1789578857.361501:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.361566:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578857.362061:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070720 00000100:00100000:0.0:1789578857.362071:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070720 00000100:00100000:0.0:1789578857.362247:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789578857.362259:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277070720:12345-0@lo:101: 00010000:00010000:0.0:1789578857.362277:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578857.362296:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c25 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578857.362338:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c25 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578857.362369:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c25 expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578857.362392:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789578857.362456:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277070720:12345-0@lo:101: Request processed in 199us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.362463:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789578857.362527:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070720:0@lo:101: 00010000:00010000:0.0:1789578857.362545:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578857.362557:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578857.362637:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070848:0@lo:501: 00000100:00100000:0.0:1789578857.362671:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.362691:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578857.362705:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070848 00000100:00100000:0.0:1789578857.362709:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070848 00000100:00100000:0.0:1789578857.362726:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789578857.362731:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277070848:12345-0@lo:501: 00000100:00100000:0.0:1789578857.363033:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277070848:12345-0@lo:501: Request processed in 300us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.363041:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789578857.363072:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070848:0@lo:501: 00000100:00100000:0.0:1789578857.363104:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070976:0@lo:503: 00000100:00100000:0.0:1789578857.363146:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.363158:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578857.363176:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277070976 00000100:00100000:0.0:1789578857.363179:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277070976 00000100:00100000:0.0:1789578857.363194:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789578857.363198:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277070976:12345-0@lo:503: 00000100:00100000:0.0:1789578857.363285:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277070976:12345-0@lo:503: Request processed in 86us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.363291:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789578857.363926:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277070976:0@lo:503: 00000100:00100000:0.0:1789578857.375909:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10014:1876509277071104:0@lo:502: 00000100:00100000:0.0:1789578857.376024:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.376120:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460000 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.378973:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071104 00000100:00100000:1.0:1789578857.378993:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071104 00000100:00100000:0.0:1789578857.385078:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789578857.385096:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10014:x1876509277071104:12345-0@lo:502: 00000100:00100000:0.0:1789578857.385370:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10014:x1876509277071104:12345-0@lo:502: Request processed in 256us (9324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.385380:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789578857.385509:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10014:1876509277071104:0@lo:502: 00000100:00100000:3.0:1789578857.385597:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10014:1876509277071232:0@lo:502: 00000100:00100000:3.0:1789578857.385646:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.392177:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.394919:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071232 00000100:00100000:1.0:1789578857.394939:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071232 00000100:00100000:1.0:1789578857.395020:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789578857.395032:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10014:x1876509277071232:12345-0@lo:502: 00000100:00100000:1.0:1789578857.395254:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10014:x1876509277071232:12345-0@lo:502: Request processed in 224us (9606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.395263:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789578857.398488:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10014:1876509277071232:0@lo:502: 00000040:00080000:3.0:1789578857.398553:0:10014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789578857.400478:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789578857.400526:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789578857.400543:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.400558:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578857.400570:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789578857.400573:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940f42d800 from 6 10000000:01000000:2.0:1789578857.400576:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789578857.400632:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.400641:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.400654:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.400682:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071360:0@lo:101: 00000100:00100000:2.0:1789578857.400772:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.400847:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.401084:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071360 00000100:00100000:3.0:1789578857.401094:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071360 00000100:00100000:3.0:1789578857.401158:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789578857.401168:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277071360:12345-0@lo:101: 00010000:00010000:3.0:1789578857.401183:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578857.401202:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519e00/0xd90373d592f20c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c33 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.401230:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519e00/0xd90373d592f20c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c33 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.401242:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519e00/0xd90373d592f20c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c33 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.401251:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519e00, rc 0) 00000100:00100000:3.0:1789578857.401306:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277071360:12345-0@lo:101: Request processed in 139us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.401313:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789578857.402518:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071360:0@lo:101: 00010000:00010000:3.0:1789578857.402547:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.402567:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.402640:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071488:0@lo:256: 00000100:00100000:3.0:1789578857.402695:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.402723:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789578857.403521:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071488 00000100:00100000:2.0:1789578857.403533:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071488 00000100:00100000:2.0:1789578857.403628:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789578857.403639:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277071488:12345-0@lo:256: 20000000:01000000:2.0:1789578857.403665:0:6482:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789578857.403685:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789578857.403688:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789578857.403814:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277071488:12345-0@lo:256: Request processed in 176us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578857.403823:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789578857.404077:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071488:0@lo:256: 10000000:01000000:3.0:1789578857.404149:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789578857.404160:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404171:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578857.404180:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789578857.404183:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789578857.404187:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789578857.404226:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404235:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404246:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.404264:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071616:0@lo:101: 00000100:00100000:3.0:1789578857.404309:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.404382:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.404401:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071616 00000100:00100000:3.0:1789578857.404407:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071616 00000100:00100000:3.0:1789578857.404435:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789578857.404442:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277071616:12345-0@lo:101: 00010000:00010000:3.0:1789578857.404452:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578857.404467:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c41 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404491:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c41 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404502:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c41 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404511:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:3.0:1789578857.404544:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277071616:12345-0@lo:101: Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.404550:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789578857.404582:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071616:0@lo:101: 00010000:00010000:3.0:1789578857.404595:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.404604:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.404666:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071744:0@lo:501: 00000100:00100000:3.0:1789578857.404700:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.404713:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.404723:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071744 00000100:00100000:3.0:1789578857.404726:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071744 00000100:00100000:3.0:1789578857.404744:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789578857.404749:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277071744:12345-0@lo:501: 00000100:00100000:3.0:1789578857.404900:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277071744:12345-0@lo:501: Request processed in 149us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.404907:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789578857.404938:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071744:0@lo:501: 00000100:00100000:3.0:1789578857.404968:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071872:0@lo:503: 00000100:00100000:3.0:1789578857.405014:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.405028:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.405040:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277071872 00000100:00100000:3.0:1789578857.405043:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277071872 00000100:00100000:3.0:1789578857.405057:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789578857.405062:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277071872:12345-0@lo:503: 00000100:00100000:3.0:1789578857.405137:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277071872:12345-0@lo:503: Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.405143:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789578857.405176:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277071872:0@lo:503: 00000100:00100000:3.0:1789578857.405434:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10017:1876509277072000:0@lo:502: 00000100:00100000:3.0:1789578857.405465:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.405482:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072000 00000100:00100000:3.0:1789578857.405485:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072000 00000100:00100000:3.0:1789578857.405502:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789578857.405515:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10017:x1876509277072000:12345-0@lo:502: 00000100:00100000:3.0:1789578857.405586:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10017:x1876509277072000:12345-0@lo:502: Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.405593:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789578857.405618:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64240 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.405629:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10017:1876509277072000:0@lo:502: 00000020:01000000:3.0:1789578857.405651:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789578857.405659:0:10017:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789578857.405667:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578857.405670:0:10017:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789578857.405674:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789578857.405678:0:10017:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789578857.405710:0:10017:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789578857.405712:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789578857.405737:0:10017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93943f540000) 00000020:00000080:3.0:1789578857.405767:0:10017:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789578857.405775:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789578857.405880:0:10017:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789578857.405888:0:10017:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789578857.405895:0:10017:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f20c56 00010000:00080000:3.0:1789578857.405929:0:10017:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93943f587000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578857.406183:0:10017:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789578857.406333:0:10017:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789578857.406346:0:10017:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789578857.406580:0:10017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578857.406715:0:10017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578857.406900:0:10017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789578857.407004:0:10017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789578857.420950:0:10018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789578857.420977:0:10018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789578857.426763:0:10017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789578857.426784:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789578857.426854:0:10017:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789578857.426889:0:10017:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20c5d 00000100:00080000:3.0:1789578857.426903:0:10017:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789578857.426918:0:10017:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93943f587000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789578857.426968:0:10017:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303b14e00 x1876509277072128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789578857.427022:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277072128:0@lo:8: 00000100:00100000:3.0:1789578857.427112:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.427199:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072128 00000100:00100000:3.0:1789578857.427209:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072128 00000100:00100000:3.0:1789578857.427252:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578857.427263:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3614:x1876509277072128:12345-0@lo:8: 00010000:00080000:3.0:1789578857.427298:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1789578857.429636:0:8403:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f20c64 00002000:00100000:3.0:1789578857.429668:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93943f580800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789578857.429675:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789578857.429681:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789578857.429771:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789578857.430101:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789578857.430145:0:8403:0:(import.c:65:import_set_state_nolock()) ffff93943f582000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578857.430340:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277072128:12345-0@lo:8: Request processed in 3075us (3225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.430374:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789578857.430420:0:10017:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789578857.430590:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277072384:0@lo:400: 00000100:00100000:3.0:1789578857.430650:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430682:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277072896:0@lo:400: 00000100:00100000:3.0:1789578857.430707:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430725:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277073408:0@lo:400: 00000100:00100000:3.0:1789578857.430746:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430771:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789578857.430777:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277072256:0@lo:400: 00000100:00100000:3.0:1789578857.430812:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430830:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277072768:0@lo:400: 00000100:00100000:3.0:1789578857.430851:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430868:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277073280:0@lo:400: 00000100:00100000:3.0:1789578857.430895:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430917:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277072512:0@lo:400: 00000100:00100000:3.0:1789578857.430941:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430952:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277073024:0@lo:400: 00000100:00100000:3.0:1789578857.430971:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.430988:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789578857.430994:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277072640:0@lo:400: 00000100:00100000:3.0:1789578857.431015:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.431031:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277073152:0@lo:400: 00000100:00100000:3.0:1789578857.431049:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.431082:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072384 00000100:00100000:3.0:1789578857.431090:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072384 00000100:00100000:3.0:1789578857.431131:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072640 00000100:00100000:3.0:1789578857.431134:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072640 00000100:00100000:3.0:1789578857.431159:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789578857.431167:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277072384:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431223:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277072384:12345-0@lo:400: Request processed in 57us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431230:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789578857.431244:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789578857.431251:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277072640:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431282:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277072640:12345-0@lo:400: Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431288:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789578857.431307:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072896 00000100:00100000:3.0:1789578857.431310:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072896 00000100:00100000:3.0:1789578857.431339:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073408 00000100:00100000:3.0:1789578857.431341:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073408 00000100:00100000:3.0:1789578857.431389:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072256 00000100:00100000:3.0:1789578857.431392:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072256 00000100:00100000:3.0:1789578857.431403:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072768 00000100:00100000:3.0:1789578857.431405:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072768 00000100:00100000:3.0:1789578857.431418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073280 00000100:00100000:3.0:1789578857.431421:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073280 00000100:00100000:3.0:1789578857.431434:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277072512 00000100:00100000:3.0:1789578857.431437:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277072512 00000100:00100000:3.0:1789578857.431452:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789578857.431458:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277072896:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431489:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277072896:12345-0@lo:400: Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431496:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789578857.431508:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789578857.431514:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277073408:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431550:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277073408:12345-0@lo:400: Request processed in 37us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431557:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789578857.431569:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789578857.431575:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277072256:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431601:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277072256:12345-0@lo:400: Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431606:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789578857.431617:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578857.431622:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277072768:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431648:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277072768:12345-0@lo:400: Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431653:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578857.431664:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789578857.431670:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277073280:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431694:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277073280:12345-0@lo:400: Request processed in 24us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431700:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789578857.431711:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578857.431717:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277072512:12345-0@lo:400: 00000100:00100000:3.0:1789578857.431742:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277072512:12345-0@lo:400: Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.431748:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578857.431769:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073024 00000100:00100000:3.0:1789578857.431773:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073024 00000100:00080000:0.0:1789578857.433011:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578857.433021:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578857.433024:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578857.436477:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073152 00000100:00100000:3.0:1789578857.436506:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073152 00000100:00100000:3.0:1789578857.436595:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578857.436607:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277073024:12345-0@lo:400: 00000100:00100000:3.0:1789578857.436722:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277073024:12345-0@lo:400: Request processed in 117us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.436730:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789578857.436749:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789578857.436755:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277073152:12345-0@lo:400: 00000100:00100000:3.0:1789578857.436784:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277073152:12345-0@lo:400: Request processed in 30us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.436791:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789578857.436875:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15180 x1876509277072256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.436893:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277072256:0@lo:400: 00010000:00080000:3.0:1789578857.436908:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17800 x1876509277072768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.436917:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277072768:0@lo:400: 00010000:00080000:3.0:1789578857.436932:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15f80 x1876509277073280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.436941:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277073280:0@lo:400: 00000100:00100000:3.0:1789578857.436954:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277072384:0@lo:400: 00010000:00080000:3.0:1789578857.436966:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17b80 x1876509277072896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.436974:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277072896:0@lo:400: 00010000:00080000:3.0:1789578857.436998:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16300 x1876509277073408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.437007:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277073408:0@lo:400: 00000100:00100000:3.0:1789578857.437072:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277072640:0@lo:400: 00010000:00080000:3.0:1789578857.437084:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17100 x1876509277073152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.437093:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277073152:0@lo:400: 00010000:00080000:3.0:1789578857.437106:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b14a80 x1876509277072512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.437115:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277072512:0@lo:400: 00010000:00080000:3.0:1789578857.437126:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16d80 x1876509277073024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.437134:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277073024:0@lo:400: 00000020:01000000:3.0:1789578857.437226:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578857.437234:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578857.437236:0:10017:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789578857.437240:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578857.437245:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578857.437247:0:10017:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789578857.437250:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789578857.437252:0:10017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789578857.437294:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10017:1876509277073536:0@lo:502: 00000100:00080000:0.0:1789578857.437453:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789578857.439548:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b14e00 x1876509277072128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789578867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.439569:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789578857.439583:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789578857.439594:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789578857.439602:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789578857.439606:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93943f587000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789578857.439624:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789578857.439631:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277072128:0@lo:8: 00000004:00080000:3.0:1789578857.439989:0:10018:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789578857.440093:0:10018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 212572741644ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789578857.440102:0:10018:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789578857.440223:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.440270:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073536 00000100:00100000:3.0:1789578857.440278:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073536 00000100:00100000:0.0:1789578857.440484:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789578857.440499:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10017:x1876509277073536:12345-0@lo:502: 00000100:00100000:0.0:1789578857.440661:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10017:x1876509277073536:12345-0@lo:502: Request processed in 165us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.440670:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789578857.442482:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.442531:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10017:1876509277073536:0@lo:502: 00000020:01000000:3.0:1789578857.442585:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578857.442596:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578857.442599:0:10017:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789578857.442604:0:10017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789578857.442704:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789578857.442729:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789578857.442742:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.442756:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578857.442768:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578857.442771:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940679b000 from 39 10000000:01000000:3.0:1789578857.442775:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578857.442828:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.442837:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.442849:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.442874:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277073664:0@lo:101: 00000100:00100000:3.0:1789578857.442944:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.442987:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.444258:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073664 00000100:00100000:1.0:1789578857.444273:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073664 00000100:00100000:1.0:1789578857.444444:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789578857.444456:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277073664:12345-0@lo:101: 00010000:00010000:1.0:1789578857.444483:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578857.444501:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c6b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.444528:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277073792:0@lo:700: 00010000:00010000:1.0:1789578857.444530:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c6b expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.444552:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c6b expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.444562:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e600, rc 0) 00000100:00100000:3.0:1789578857.444618:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.449635:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277073664:12345-0@lo:101: Request processed in 5172us (6681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.449649:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789578857.449719:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277073664:0@lo:101: 00010000:00010000:1.0:1789578857.449745:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.449759:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578857.449858:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277073920:0@lo:501: 00000100:00100000:1.0:1789578857.449909:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.449942:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298900 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.450115:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073920 00000100:00100000:1.0:1789578857.450122:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073920 00000100:00100000:1.0:1789578857.450171:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789578857.450192:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277073920:12345-0@lo:501: 00000100:00100000:1.0:1789578857.450321:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277073920:12345-0@lo:501: Request processed in 129us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.450328:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789578857.450820:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277073920:0@lo:501: 00000100:00100000:1.0:1789578857.450852:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074048:0@lo:503: 00000100:00100000:1.0:1789578857.450910:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.450930:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298900 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.450960:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074048 00000100:00100000:1.0:1789578857.450965:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074048 00000100:00100000:1.0:1789578857.450982:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789578857.450988:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277074048:12345-0@lo:503: 00000100:00100000:1.0:1789578857.451087:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277074048:12345-0@lo:503: Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.451095:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789578857.451150:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277073792 00000100:00100000:3.0:1789578857.451164:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277073792 00000100:00100000:3.0:1789578857.451386:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789578857.451410:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10020:x1876509277073792:12345-0@lo:700: 00000100:00100000:3.0:1789578857.451446:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1876509277074176:0@lo:700: 00000100:00100000:3.0:1789578857.451476:0:8412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.451503:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290bed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.451670:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.451922:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074048:0@lo:503: 00000100:00080000:0.0:1789578857.453015:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789578857.456365:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789578857.456683:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074176 00000100:00100000:1.0:1789578857.456694:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074176 00000100:00100000:1.0:1789578857.456742:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789578857.456752:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1876509277074176:12345-0@lo:700: 00000100:00100000:1.0:1789578857.458767:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10021:1876509277074304:0@lo:502: 00000100:00100000:1.0:1789578857.458871:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.458918:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074304 00000100:00100000:1.0:1789578857.458926:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074304 00000100:00100000:1.0:1789578857.458974:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789578857.458982:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10021:x1876509277074304:12345-0@lo:502: 00000100:00100000:1.0:1789578857.459088:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10021:x1876509277074304:12345-0@lo:502: Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.459095:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789578857.459146:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.459275:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10021:1876509277074304:0@lo:502: 00000100:00100000:1.0:1789578857.459321:0:10021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10021:1876509277074432:0@lo:502: 00000100:00100000:1.0:1789578857.459435:0:10021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.459458:0:10021:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.463450:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074432 00000100:00100000:1.0:1789578857.463466:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074432 00000100:00100000:1.0:1789578857.463523:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789578857.463533:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10021:x1876509277074432:12345-0@lo:502: 00000100:00100000:1.0:1789578857.463688:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10021:x1876509277074432:12345-0@lo:502: Request processed in 156us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.463696:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789578857.463767:0:10021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10021:1876509277074432:0@lo:502: 00000040:00080000:1.0:1789578857.463813:0:10021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789578857.464056:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789578857.464080:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789578857.464090:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.464102:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578857.464111:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789578857.464123:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93940679b000 from 6 10000000:01000000:3.0:1789578857.464128:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789578857.464160:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.464168:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.464176:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.464206:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074560:0@lo:101: 00000100:00100000:3.0:1789578857.464242:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.464277:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.464450:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074560 00000100:00100000:1.0:1789578857.464455:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074560 00000100:00100000:1.0:1789578857.464485:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789578857.464493:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277074560:12345-0@lo:101: 00010000:00010000:1.0:1789578857.464503:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578857.464516:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f600/0xd90373d592f20c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c79 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.464552:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f600/0xd90373d592f20c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c79 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.464563:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f600/0xd90373d592f20c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c79 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.464572:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f600, rc 0) 00000100:00100000:1.0:1789578857.464611:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277074560:12345-0@lo:101: Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.464618:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789578857.465063:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074560:0@lo:101: 00010000:00010000:3.0:1789578857.465078:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.465089:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.465150:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074688:0@lo:256: 00000100:00100000:3.0:1789578857.465185:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.465217:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.465436:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074688 00000100:00100000:1.0:1789578857.465442:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074688 00000100:00100000:1.0:1789578857.465469:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789578857.465475:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277074688:12345-0@lo:256: 20000000:01000000:1.0:1789578857.465488:0:6484:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789578857.465506:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789578857.465509:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789578857.465593:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277074688:12345-0@lo:256: Request processed in 117us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.465601:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789578857.467404:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074688:0@lo:256: 10000000:01000000:3.0:1789578857.467481:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789578857.467491:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.467502:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578857.467511:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789578857.467514:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789578857.467517:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789578857.467559:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.467581:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.467591:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.467610:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074816:0@lo:101: 00000100:00100000:3.0:1789578857.467659:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.467708:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.467750:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074816 00000100:00100000:1.0:1789578857.467757:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074816 00000100:00100000:1.0:1789578857.467811:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789578857.467820:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277074816:12345-0@lo:101: 00010000:00010000:1.0:1789578857.467832:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578857.467843:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20c87 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.467877:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20c87 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.467886:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c87 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578857.467893:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f400, rc 0) 00000100:00100000:1.0:1789578857.467940:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277074816:12345-0@lo:101: Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.467947:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789578857.468146:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074816:0@lo:101: 00010000:00010000:3.0:1789578857.468160:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.468170:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578857.468245:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074944:0@lo:501: 00000100:00100000:3.0:1789578857.468273:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.468293:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.468479:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277074944 00000100:00100000:1.0:1789578857.468484:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277074944 00000100:00100000:1.0:1789578857.468511:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789578857.468518:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277074944:12345-0@lo:501: 00000100:00100000:1.0:1789578857.468654:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277074944:12345-0@lo:501: Request processed in 134us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.468661:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789578857.468696:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277074944:0@lo:501: 00000100:00100000:1.0:1789578857.468739:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075072:0@lo:503: 00000100:00100000:1.0:1789578857.468780:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.468812:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075072 00000100:00100000:1.0:1789578857.468816:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075072 00000100:00100000:1.0:1789578857.468839:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789578857.468846:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277075072:12345-0@lo:503: 00000100:00100000:1.0:1789578857.468929:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277075072:12345-0@lo:503: Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.468945:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789578857.468988:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.469001:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075072:0@lo:503: 00000100:00100000:3.0:1789578857.469902:0:10022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10022:1876509277075200:0@lo:502: 00000100:00100000:3.0:1789578857.469951:0:10022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.469977:0:10022:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.470021:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075200 00000100:00100000:1.0:1789578857.470037:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075200 00000100:00100000:1.0:1789578857.470071:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789578857.470079:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10022:x1876509277075200:12345-0@lo:502: 00000100:00100000:1.0:1789578857.470190:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10022:x1876509277075200:12345-0@lo:502: Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.470197:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789578857.470327:0:10022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f590700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10022:1876509277075200:0@lo:502: 00000020:01000000:3.0:1789578857.470391:0:10022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789578857.470398:0:10022:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789578857.470404:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578857.470412:0:10022:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789578857.470416:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789578857.470420:0:10022:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789578857.470443:0:10022:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789578857.470446:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789578857.470462:0:10022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93943f543380) 00000020:00000080:3.0:1789578857.470495:0:10022:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789578857.470501:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789578857.470582:0:10022:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789578857.470588:0:10022:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789578857.470595:0:10022:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f20c9c 00010000:00080000:3.0:1789578857.470622:0:10022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939303a24800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789578857.470947:0:10022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 40000000:02000000:1.0:1789578857.471325:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:01000000:3.0:1789578857.478270:0:10022:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789578857.478290:0:10022:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789578857.478495:0:10022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578857.478609:0:10022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789578857.478763:0:10022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789578857.478862:0:10022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1789578857.491179:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1876509277074176:12345-0@lo:700: Request processed in 34416us (39689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.491194:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789578857.491254:0:8412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f591880 x1876509277074176/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.491270:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1876509277074176:0@lo:700: 40000000:02000000:1.0:1789578857.491283:0:8412:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1789578857.491448:0:10023:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789578857.491461:0:10023:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789578857.501857:0:10022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789578857.501881:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789578857.501942:0:10022:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789578857.501974:0:10022:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20ca3 00000100:00080000:0.0:1789578857.501988:0:10022:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789578857.502002:0:10022:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939303a24800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789578857.502053:0:10022:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93940f40df80 x1876509277075328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789578857.502096:0:10022:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789578857.502169:0:10022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578857.502175:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578857.502177:0:10022:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789578857.502181:0:10022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578857.502187:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578857.502189:0:10022:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789578857.502193:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789578857.502195:0:10022:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789578857.502328:0:10022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10022:1876509277075456:0@lo:502: 00000100:00100000:0.0:1789578857.502482:0:10022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.502552:0:10022:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.510132:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277075328:0@lo:8: 00000100:00100000:3.0:1789578857.510212:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.511130:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075456 00000100:00100000:1.0:1789578857.511141:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075456 00000100:00100000:1.0:1789578857.511188:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789578857.511197:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10022:x1876509277075456:12345-0@lo:502: 00000100:00100000:0.0:1789578857.512150:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075328 00000100:00100000:0.0:1789578857.512165:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075328 00000100:00100000:0.0:1789578857.512231:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789578857.512241:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3614:x1876509277075328:12345-0@lo:8: 00010000:00080000:0.0:1789578857.512283:0:8404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1789578857.512454:0:8404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f20caa 00002000:00100000:0.0:1789578857.512482:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93930232c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:1.0:1789578857.512499:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10022:x1876509277075456:12345-0@lo:502: Request processed in 1013us (9727us total) trans 0 rc 0/0 00002000:00080000:0.0:1789578857.512502:0:8404:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789578857.512509:0:8404:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789578857.512520:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789578857.512613:0:10022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10022:1876509277075456:0@lo:502: 00002000:00080000:0.0:1789578857.512615:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789578857.512654:0:8404:0:(import.c:65:import_set_state_nolock()) ffff93942f20e800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1789578857.512655:0:10022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578857.512666:0:10022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578857.512669:0:10022:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789578857.512673:0:10022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1789578857.512751:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277075328:12345-0@lo:8: Request processed in 509us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.512760:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789578857.512839:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40df80 x1876509277075328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789578867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.512852:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789578857.512860:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789578857.512869:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789578857.512876:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789578857.512879:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939303a24800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789578857.512901:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789578857.512913:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277075328:0@lo:8: 00000004:00080000:0.0:1789578857.513030:0:10023:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789578857.513101:0:10023:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212645749930ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789578857.513110:0:10023:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789578857.514928:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789578857.515089:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578857.515119:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277075584:0@lo:13: 00000100:00100000:0.0:1789578857.515214:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.515294:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075584 00000100:00100000:0.0:1789578857.515304:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075584 00000100:00100000:0.0:1789578857.515404:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789578857.515417:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277075584:12345-0@lo:13: 00002000:00000024:0.0:1789578857.515461:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789578857.515787:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277075584:12345-0@lo:13: Request processed in 371us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.515806:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789578857.515849:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789578857.515867:0:10025:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789578857.515899:0:10025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277075712:0@lo:7: 00000100:00100000:0.0:1789578857.515941:0:10025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.515990:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075712 00000100:00100000:0.0:1789578857.515995:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075712 00000100:00100000:0.0:1789578857.516040:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789578857.516060:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10025:x1876509277075712:12345-0@lo:7: 00000100:00100000:0.0:1789578857.516241:0:10025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cbb40 going to sleep for 11 seconds 00010000:00080000:1.0:1789578857.518012:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40df80 x1876509277075584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.518056:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277075584:0@lo:13: 00000001:00100000:0.0:1789578857.519072:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789578857.519083:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789578857.519244:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277073792:12345-0@lo:700: Request processed in 67834us (74622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.519258:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789578857.521475:0:10020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f593100 x1876509277073792/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578857.521494:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277073792:0@lo:700: 00000020:01000000:3.0:1789578857.522653:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789578857.522689:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789578857.522701:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.522714:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578857.523455:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789578857.523461:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93941008b380 from 1 10000000:01000000:2.0:1789578857.523464:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789578857.523501:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.523511:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.523522:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.523544:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075840:0@lo:101: 00000100:00100000:2.0:1789578857.523606:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.523649:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.523728:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075840 00000100:00100000:3.0:1789578857.523736:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075840 00000100:00100000:3.0:1789578857.523782:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789578857.523791:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277075840:12345-0@lo:101: 00010000:00010000:3.0:1789578857.523815:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578857.523828:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20cb1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.523852:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.523862:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578857.523870:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:3.0:1789578857.523906:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277075840:12345-0@lo:101: Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.523912:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789578857.523999:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075840:0@lo:101: 00010000:00010000:2.0:1789578857.524012:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.524038:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578857.524097:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075968:0@lo:501: 00000100:00100000:2.0:1789578857.524124:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.524147:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.524244:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277075968 00000100:00100000:3.0:1789578857.524255:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277075968 00000100:00100000:3.0:1789578857.524286:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789578857.524293:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277075968:12345-0@lo:501: 00000100:00100000:3.0:1789578857.524492:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277075968:12345-0@lo:501: Request processed in 200us (367us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789578857.524499:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789578857.524747:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277075968:0@lo:501: 10000000:01000000:2.0:1789578857.524777:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789578857.524783:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578857.524792:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789578857.527662:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789578857.527672:0:8405:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789578857.528870:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10025:x1876509277075712:12345-0@lo:7: Request processed in 12807us (12927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.528888:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789578857.532648:0:10025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40d500 x1876509277075712/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578857.532668:0:10025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277075712:0@lo:7: 00000004:00080000:2.0:1789578857.532683:0:10025:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789578857.532722:0:10025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076096:0@lo:5: 00000100:00100000:2.0:1789578857.532773:0:10025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.532861:0:10025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.536217:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076096 00000100:00100000:1.0:1789578857.536230:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076096 00000004:00080000:1.0:1789578857.541918:0:10020:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789578857.541952:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076352:0@lo:7: 00000100:00100000:1.0:1789578857.542022:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.542106:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578857.542119:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277076224:0@lo:13: 00000100:00100000:3.0:1789578857.542147:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.542198:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076224 00000100:00100000:3.0:1789578857.542204:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076224 00000100:00100000:3.0:1789578857.542243:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578857.542251:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277076224:12345-0@lo:13: 00002000:00000024:3.0:1789578857.542269:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789578857.542306:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277076224:12345-0@lo:13: Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.542313:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789578857.542384:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350dc00 x1876509277076224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.542403:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277076224:0@lo:13: 00000100:00100000:1.0:1789578857.542557:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.542594:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076352 00000100:00100000:3.0:1789578857.542599:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076352 00000100:00100000:3.0:1789578857.542627:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578857.542634:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277076352:12345-0@lo:7: 00002000:00080000:3.0:1789578857.547016:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789578857.547026:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789578857.547180:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277076352:12345-0@lo:7: Request processed in 4542us (5153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578857.547195:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789578857.547222:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789578857.547233:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10025:x1876509277076096:12345-0@lo:5: 00002000:00080000:3.0:1789578857.547259:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789578857.547262:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1789578857.547450:0:10020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350c700 x1876509277076352/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.547465:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076352:0@lo:7: 00000004:00080000:1.0:1789578857.547477:0:10020:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789578857.547508:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076480:0@lo:5: 00000100:00100000:1.0:1789578857.547540:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.547561:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.547575:0:8405:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789578857.547587:0:8405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789578857.547678:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076480 00000100:00100000:1.0:1789578857.547685:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076480 00000100:00100000:1.0:1789578857.547764:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789578857.547772:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277076480:12345-0@lo:5: 00002000:00080000:1.0:1789578857.547784:0:10029:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789578857.547827:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277076480:12345-0@lo:5: Request processed in 56us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.547833:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789578857.547854:0:10020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350c700 x1876509277076480/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.547864:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076480:0@lo:5: 00000004:00080000:1.0:1789578857.547872:0:10020:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789578857.547892:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076608:0@lo:5: 00000100:00100000:1.0:1789578857.547925:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.547939:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.547949:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076608 00000100:00100000:1.0:1789578857.547952:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076608 00000100:00100000:1.0:1789578857.547967:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789578857.547972:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10020:x1876509277076608:12345-0@lo:5: 00002000:00080000:1.0:1789578857.547993:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789578857.548624:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10025:x1876509277076096:12345-0@lo:5: Request processed in 1392us (15848us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789578857.548632:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789578857.549467:0:10025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437205180 x1876509277076096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.549484:0:10025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437205180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076096:0@lo:5: 00000004:00080000:3.0:1789578857.549496:0:10025:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789578857.549525:0:10025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076736:0@lo:700: 00000100:00100000:3.0:1789578857.549558:0:10025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578857.549579:0:10025:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942906ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.549595:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076736 00000100:00100000:3.0:1789578857.549600:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076736 00000100:00100000:3.0:1789578857.549630:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789578857.549637:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10025:x1876509277076736:12345-0@lo:700: 00000100:00100000:1.0:1789578857.550607:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10020:x1876509277076608:12345-0@lo:5: Request processed in 2631us (2678us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789578857.550617:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789578857.550730:0:10020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350c700 x1876509277076608/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578857.550744:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10020:1876509277076608:0@lo:5: 00000004:00080000:0.0:1789578857.550755:0:10020:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789578857.550784:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10020:1876509277076864:0@lo:900: 00000100:00100000:0.0:1789578857.550823:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.550848:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578857.550885:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076864 00000100:00100000:1.0:1789578857.550890:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076864 00000100:00100000:1.0:1789578857.550922:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789578857.550929:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10020:x1876509277076864:12345-0@lo:900: 00000100:00100000:1.0:1789578857.550972:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10020:x1876509277076864:12345-0@lo:900: Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.550978:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789578857.551039:0:10020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437389f80 x1876509277076864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578857.551048:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10020:1876509277076864:0@lo:900: 00000001:00080000:3.0:1789578857.558144:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789578857.558160:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789578857.558628:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10025:x1876509277076736:12345-0@lo:700: Request processed in 8985us (9063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.558640:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789578857.563290:0:10025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f593100 x1876509277076736/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578857.563305:0:10025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789578857.563535:0:10025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076736:0@lo:700: 00010000:00010000:0.0:1789578857.573084:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1789578857.576819:0:10025:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1789578857.584259:0:10025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076992:0@lo:5: 00000100:00100000:2.0:1789578857.585127:0:10025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578857.585179:0:10025:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578857.585229:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277076992 00000100:00100000:3.0:1789578857.585238:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277076992 00000100:00100000:3.0:1789578857.585344:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789578857.585387:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10025:x1876509277076992:12345-0@lo:5: 00002000:00080000:3.0:1789578857.594945:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789578857.594963:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789578857.598539:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10025:x1876509277076992:12345-0@lo:5: Request processed in 13181us (14207us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789578857.598551:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789578857.599806:0:10025:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4f480 x1876509277076992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789578873 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578857.599837:0:10025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10025:1876509277076992:0@lo:5: 00000004:00080000:2.0:1789578857.599853:0:10025:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:0.0:1789578857.827485:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578857.827511:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277077120:0@lo:13: 00000100:00100000:0.0:1789578857.827579:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578857.827654:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077120 00000100:00100000:0.0:1789578857.827668:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077120 00000100:00100000:0.0:1789578857.827715:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578857.827725:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277077120:12345-0@lo:13: 00002000:00000024:0.0:1789578857.827752:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578857.827809:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277077120:12345-0@lo:13: Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578857.827815:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789578857.827857:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437389f80 x1876509277077120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578857.827875:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277077120:0@lo:13: 00000100:00100000:0.0:1789578857.828005:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277077248:0@lo:13: 00000100:00100000:0.0:1789578857.828042:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578857.828209:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077248 00000100:00100000:1.0:1789578857.828215:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077248 00000100:00100000:1.0:1789578857.828248:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789578857.828255:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277077248:12345-0@lo:13: 00002000:00000024:1.0:1789578857.828267:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578857.828302:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277077248:12345-0@lo:13: Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578857.828308:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789578857.828335:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350dc00 x1876509277077248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578857.828367:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277077248:0@lo:13: 00000020:00000004:0.0:1789578858.028751:0:10061:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578858.028760:0:10061:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789578858.554041:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.554439:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261299840 00000100:00100000:1.0:1789578858.554453:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261299840 00000100:00100000:1.0:1789578858.555213:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:1.0:1789578858.555225:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2391:x1876509261299840:12345-192.168.203.37@tcp:250: 00010000:00080000:1.0:1789578858.555268:0:6482:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d510876f-b8d4-4b66-af39-9463dcf1db3f@192.168.203.37@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1789578858.555308:0:6482:0:(genops.c:1384:class_connect()) connect: client d510876f-b8d4-4b66-af39-9463dcf1db3f, cookie 0xd90373d592f20cbf 00000100:00080000:1.0:1789578858.557103:0:6482:0:(import.c:65:import_set_state_nolock()) ffff939303513800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789578858.557206:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+5:2391:x1876509261299840:12345-192.168.203.37@tcp:250: Request processed in 1980us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.557219:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:0.0:1789578858.564861:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.566645:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261299968 00000100:00100000:1.0:1789578858.566665:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261299968 00000100:00100000:1.0:1789578858.566773:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:1.0:1789578858.566784:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+5:6151:x1876509261299968:12345-192.168.203.37@tcp:101: 00010000:00010000:1.0:1789578858.566820:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578858.566846:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebd7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.566886:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.566900:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.566911:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f800, rc 0) 00000100:00100000:1.0:1789578858.567001:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+6:6151:x1876509261299968:12345-192.168.203.37@tcp:101: Request processed in 217us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.567008:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:2.0:1789578858.572130:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.573135:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300096 00000100:00100000:1.0:1789578858.573151:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300096 00000100:00100000:1.0:1789578858.573243:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00100000:1.0:1789578858.573255:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+6:6151:x1876509261300096:12345-192.168.203.37@tcp:501: 00000100:00100000:1.0:1789578858.573459:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+6:6151:x1876509261300096:12345-192.168.203.37@tcp:501: Request processed in 206us (1343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789578858.573468:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00100000:2.0:1789578858.576449:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.576644:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300224 00000100:00100000:3.0:1789578858.576656:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300224 00000100:00100000:3.0:1789578858.576729:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:3.0:1789578858.576741:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+6:6151:x1876509261300224:12345-192.168.203.37@tcp:101: 00010000:00010000:3.0:1789578858.576763:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578858.576797:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebd85 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.576838:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.576851:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.576862:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518000, rc 0) 00000100:00100000:3.0:1789578858.576937:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+7:6151:x1876509261300224:12345-192.168.203.37@tcp:101: Request processed in 197us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.576967:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:0.0:1789578858.584567:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578858.584826:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300352 00000100:00100000:2.0:1789578858.584840:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300352 00000100:00100000:2.0:1789578858.584914:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:2.0:1789578858.584926:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+7:6151:x1876509261300352:12345-192.168.203.37@tcp:501: 00000100:00100000:2.0:1789578858.585147:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6151:x1876509261300352:12345-192.168.203.37@tcp:501: Request processed in 222us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578858.585156:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:2.0:1789578858.589855:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.589975:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300480 00000100:00100000:1.0:1789578858.589988:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300480 00000100:00100000:1.0:1789578858.590056:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:1.0:1789578858.590067:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6151:x1876509261300480:12345-192.168.203.37@tcp:503: 00000100:00100000:1.0:1789578858.590283:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6151:x1876509261300480:12345-192.168.203.37@tcp:503: Request processed in 216us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.590301:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 184 00010000:00010000:0.0:1789578858.595907:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578858.597494:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.597680:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300608 00000100:00100000:3.0:1789578858.597694:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300608 00000100:00100000:3.0:1789578858.597767:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:3.0:1789578858.597780:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6169:x1876509261300608:12345-192.168.203.37@tcp:502: 00000100:00100000:3.0:1789578858.598018:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6169:x1876509261300608:12345-192.168.203.37@tcp:502: Request processed in 240us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.598026:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:0.0:1789578858.629733:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578858.629848:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300736 00000100:00100000:2.0:1789578858.629862:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300736 00000100:00100000:2.0:1789578858.629938:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:2.0:1789578858.629950:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6169:x1876509261300736:12345-192.168.203.37@tcp:502: 00000100:00100000:2.0:1789578858.630162:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6169:x1876509261300736:12345-192.168.203.37@tcp:502: Request processed in 213us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578858.630169:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:2.0:1789578858.638337:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.643619:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300864 00000100:00100000:1.0:1789578858.643640:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300864 00000100:00100000:1.0:1789578858.643726:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:1.0:1789578858.643737:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6151:x1876509261300864:12345-192.168.203.37@tcp:101: 00010000:00010000:1.0:1789578858.643758:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578858.643781:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e200/0xd90373d592f20cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebdb6 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.643988:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e200/0xd90373d592f20cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdb6 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.644001:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e200/0xd90373d592f20cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdb6 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578858.644012:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e200, rc 0) 00000100:00100000:1.0:1789578858.644098:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6151:x1876509261300864:12345-192.168.203.37@tcp:101: Request processed in 362us (5776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.644105:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:0.0:1789578858.648799:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.648946:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261300992 00000100:00100000:3.0:1789578858.648960:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261300992 00000100:00100000:3.0:1789578858.649093:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:3.0:1789578858.649107:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6151:x1876509261300992:12345-192.168.203.37@tcp:256: 20000000:01000000:3.0:1789578858.649142:0:6484:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789578858.649177:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789578858.649181:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789578858.649185:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789578858.649188:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789578858.649191:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789578858.656966:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6151:x1876509261300992:12345-192.168.203.37@tcp:256: Request processed in 7847us (8234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.656985:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:2.0:1789578858.660801:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.661391:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301120 00000100:00100000:3.0:1789578858.661406:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301120 00000100:00100000:3.0:1789578858.661483:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:3.0:1789578858.661495:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6151:x1876509261301120:12345-192.168.203.37@tcp:101: 00010000:00010000:3.0:1789578858.661520:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578858.661563:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebdbd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.661602:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.661616:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578858.661627:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401687400, rc 0) 00000100:00100000:3.0:1789578858.661724:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6151:x1876509261301120:12345-192.168.203.37@tcp:101: Request processed in 231us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.661732:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:0.0:1789578858.665629:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.665782:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301248 00000100:00100000:3.0:1789578858.665804:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301248 00000100:00100000:3.0:1789578858.665991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:3.0:1789578858.666004:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6151:x1876509261301248:12345-192.168.203.37@tcp:501: 00000100:00100000:3.0:1789578858.666219:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6151:x1876509261301248:12345-192.168.203.37@tcp:501: Request processed in 216us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.666228:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:2.0:1789578858.674670:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.674860:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301376 00000100:00100000:1.0:1789578858.674874:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301376 00000100:00100000:1.0:1789578858.674983:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:1.0:1789578858.674996:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6151:x1876509261301376:12345-192.168.203.37@tcp:503: 00000100:00100000:1.0:1789578858.675208:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6151:x1876509261301376:12345-192.168.203.37@tcp:503: Request processed in 214us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.675234:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:0.0:1789578858.679072:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578858.679187:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301504 00000100:00100000:3.0:1789578858.679201:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301504 00000100:00100000:3.0:1789578858.679303:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:3.0:1789578858.679328:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6174:x1876509261301504:12345-192.168.203.37@tcp:502: 00000100:00100000:3.0:1789578858.679609:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6174:x1876509261301504:12345-192.168.203.37@tcp:502: Request processed in 295us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.679618:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:0.0:1789578858.682631:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.682732:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301632 00000100:00100000:1.0:1789578858.682744:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301632 00000100:00100000:1.0:1789578858.682818:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 193 00000100:00100000:1.0:1789578858.682830:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6174:x1876509261301632:12345-192.168.203.37@tcp:502: 00000100:00100000:1.0:1789578858.683064:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6174:x1876509261301632:12345-192.168.203.37@tcp:502: Request processed in 235us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.683073:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 193 00000100:00100000:0.0:1789578858.687633:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578858.687678:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578858.687939:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301760 00000100:00100000:1.0:1789578858.687954:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301760 00000100:00100000:1.0:1789578858.688007:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302016 00000100:00100000:1.0:1789578858.688011:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302016 00000100:00100000:1.0:1789578858.688044:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789578858.688055:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876509261301760:12345-192.168.203.37@tcp:38: 00010000:00080000:1.0:1789578858.688094:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1789578858.688162:0:6492:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f20ce2 00000004:00100000:1.0:1789578858.688195:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789578858.688424:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789578858.688431:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2391:x1876509261302016:12345-192.168.203.37@tcp:38: 00010000:00080000:0.0:1789578858.688467:0:6490:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1789578858.688505:0:6490:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f20ce9 00000004:00100000:0.0:1789578858.688519:0:6490:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789578858.688738:0:6490:0:(import.c:65:import_set_state_nolock()) ffff9393038d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578858.688859:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261302016:12345-192.168.203.37@tcp:38: Request processed in 426us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578858.688866:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00080000:1.0:1789578858.689688:0:6492:0:(import.c:65:import_set_state_nolock()) ffff939303514000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789578858.689734:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261301760:12345-192.168.203.37@tcp:38: Request processed in 1680us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578858.689744:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789578858.854214:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578858.854248:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277077376:0@lo:41: 00000100:00100000:2.0:1789578858.854341:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578858.854662:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077376 00000100:00100000:3.0:1789578858.854679:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077376 00000100:00100000:3.0:1789578858.854756:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789578858.854767:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277077376:12345-0@lo:41: 00000004:00000024:3.0:1789578858.854826:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789578858.854899:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277077376:12345-0@lo:41: Request processed in 133us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.854907:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789578858.855105:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277077376:0@lo:41: 00000100:00100000:2.0:1789578858.855994:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277077504:0@lo:41: 00000100:00100000:2.0:1789578858.856051:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578858.856139:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077504 00000100:00100000:3.0:1789578858.856146:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077504 00000100:00100000:3.0:1789578858.856194:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789578858.856203:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277077504:12345-0@lo:41: 00000004:00000024:3.0:1789578858.856236:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578858.856950:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277077504:12345-0@lo:41: Request processed in 739us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578858.856961:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789578858.857084:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277077504:0@lo:41: 00010000:00010000:0.0:1789578859.620179:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578859.696319:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578859.696452:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302272 00000100:00100000:1.0:1789578859.696466:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302272 00000100:00100000:1.0:1789578859.696556:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:1.0:1789578859.696569:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302272:12345-192.168.203.37@tcp:41: 00000004:00000024:1.0:1789578859.696620:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789578859.696719:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302272:12345-192.168.203.37@tcp:41: Request processed in 151us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578859.696727:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00080000:0.0:1789578859.697004:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578859.697193:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578859.697232:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578859.697377:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302144 00000100:00100000:0.0:1789578859.697384:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302144 00000100:00100000:0.0:1789578859.697436:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261301888 00000100:00100000:0.0:1789578859.697440:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261301888 00000100:00100000:0.0:1789578859.697472:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789578859.697482:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261302144:12345-192.168.203.37@tcp:41: 00000004:00000024:0.0:1789578859.697512:0:9792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578859.697560:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261302144:12345-192.168.203.37@tcp:41: Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578859.697567:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789578859.697584:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789578859.697591:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261301888:12345-192.168.203.37@tcp:41: 00000004:00000024:0.0:1789578859.697602:0:9792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789578859.697625:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261301888:12345-192.168.203.37@tcp:41: Request processed in 35us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578859.697631:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00080000:2.0:1789578859.698032:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578859.699740:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578859.700472:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302400 00000100:00100000:0.0:1789578859.700486:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302400 00000100:00100000:0.0:1789578859.700567:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789578859.700580:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302400:12345-192.168.203.37@tcp:40: 00000100:00100000:0.0:1789578859.700796:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302400:12345-192.168.203.37@tcp:40: Request processed in 219us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578859.700805:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789578859.706613:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578859.706668:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578859.706700:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578859.706741:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578859.706867:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302784 00000100:00100000:1.0:1789578859.706881:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302784 00000100:00100000:1.0:1789578859.706953:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789578859.706967:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302784:12345-192.168.203.37@tcp:900: 00000100:00100000:1.0:1789578859.707093:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261302784:12345-192.168.203.37@tcp:900: Request processed in 128us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578859.707102:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789578859.707403:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302528 00000100:00100000:2.0:1789578859.707409:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302528 00000100:00100000:2.0:1789578859.707440:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302656 00000100:00100000:2.0:1789578859.707444:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302656 00000100:00100000:2.0:1789578859.707465:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789578859.707472:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261302528:12345-192.168.203.37@tcp:8: 00010000:00080000:2.0:1789578859.707505:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1789578859.707545:0:8405:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f20cf0 00002000:00100000:2.0:1789578859.707560:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28fc5077-c53d-437a-bade-84c159d25114/ffff93930206c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789578859.707584:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789578859.709512:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789578859.709580:0:8405:0:(import.c:65:import_set_state_nolock()) ffff93930206e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578859.709697:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261302528:12345-192.168.203.37@tcp:8: Request processed in 2218us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578859.709711:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789578859.709763:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789578859.709772:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261302656:12345-192.168.203.37@tcp:8: 00010000:00080000:2.0:1789578859.709821:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:3.0:1789578859.710195:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261302912 00000100:00100000:3.0:1789578859.710205:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261302912 00000100:00100000:3.0:1789578859.710255:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:3.0:1789578859.710263:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261302912:12345-192.168.203.37@tcp:400: 00000100:00100000:3.0:1789578859.710304:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261302912:12345-192.168.203.37@tcp:400: Request processed in 42us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578859.710326:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 194 00000020:00000080:2.0:1789578859.711891:0:8405:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f20cf7 00002000:00100000:2.0:1789578859.711929:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28fc5077-c53d-437a-bade-84c159d25114/ffff93930206a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789578859.711956:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789578859.712111:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578859.712243:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303040 00000100:00100000:3.0:1789578859.712254:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303040 00002000:00080000:2.0:1789578859.712477:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789578859.712558:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789578859.712570:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261303040:12345-192.168.203.37@tcp:33: 00000100:00080000:2.0:1789578859.712642:0:8405:0:(import.c:65:import_set_state_nolock()) ffff93930206f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578859.712796:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261302656:12345-192.168.203.37@tcp:8: Request processed in 3021us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578859.712806:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000004:00080000:3.0:1789578859.734668:0:6493:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21984us 00000004:00200000:0.0:1789578859.762568:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789578859.762680:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+6:6151:x1876509261303040:12345-192.168.203.37@tcp:33: Request processed in 50107us (50570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578859.762695:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789578859.967006:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578859.967151:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303168 00000100:00100000:1.0:1789578859.967166:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303168 00000100:00100000:1.0:1789578859.967248:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:1.0:1789578859.967263:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:6192:x1876509261303168:12345-192.168.203.37@tcp:101: 00010000:00010000:1.0:1789578859.967293:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578859.970731:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f20cfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebdee expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.970825:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.970840:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.970855:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578859.970906:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789578859.970909:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578859.970941:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.970970:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f20cfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdee expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.970992:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdee expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578859.971002:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789578859.971006:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789578859.971010:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2fe00, rc 0) 00000100:00100000:1.0:1789578859.971088:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:6192:x1876509261303168:12345-192.168.203.37@tcp:101: Request processed in 3829us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578859.971096:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00010000:00010000:0.0:1789578860.645987:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578861.667568:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578862.151510:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578862.152677:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303296 00000100:00100000:0.0:1789578862.152702:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303296 00000100:00100000:1.0:1789578862.153093:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789578862.153110:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+7:6244:x1876509261303296:12345-192.168.203.37@tcp:41: 00000004:00000024:1.0:1789578862.153175:0:9792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789578862.153287:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+7:6244:x1876509261303296:12345-192.168.203.37@tcp:41: Request processed in 182us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578862.153307:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:2.0:1789578862.156820:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578862.158575:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578862.158791:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303424 00000100:00100000:1.0:1789578862.158805:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303424 00000100:00100000:1.0:1789578862.158903:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789578862.158927:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303424:12345-192.168.203.37@tcp:41: 00000004:00000024:1.0:1789578862.158988:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578862.159134:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303424:12345-192.168.203.37@tcp:41: Request processed in 219us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578862.159174:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00080000:2.0:1789578862.159560:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578862.163671:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578862.163870:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303552 00000100:00100000:0.0:1789578862.163884:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303552 00000100:00100000:0.0:1789578862.163993:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789578862.164007:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303552:12345-192.168.203.37@tcp:13: 00002000:00000024:0.0:1789578862.164053:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578862.164147:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303552:12345-192.168.203.37@tcp:13: Request processed in 143us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.164175:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:2.0:1789578862.164428:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578862.167601:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578862.167731:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303680 00000100:00100000:0.0:1789578862.167744:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303680 00000100:00100000:0.0:1789578862.167847:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:0.0:1789578862.167862:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303680:12345-192.168.203.37@tcp:13: 00002000:00000024:0.0:1789578862.167908:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789578862.168030:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578862.168197:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28fc5077-c53d-437a-bade-84c159d25114+6:6244:x1876509261303680:12345-192.168.203.37@tcp:13: Request processed in 332us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.168205:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00010000:00010000:2.0:1789578862.695927:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578862.948674:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578862.948695:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277077632:0@lo:13: 00000100:00100000:0.0:1789578862.948769:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578862.948831:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077632 00000100:00100000:0.0:1789578862.948838:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077632 00000100:00100000:0.0:1789578862.948887:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789578862.948896:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277077632:12345-0@lo:13: 00002000:00000024:0.0:1789578862.948917:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578862.948962:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277077632:12345-0@lo:13: Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.948968:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789578862.949006:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437356680 x1876509277077632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578862.949016:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789578862.949037:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277077632:0@lo:13: 00000100:00100000:0.0:1789578862.950437:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277077760:0@lo:13: 00000100:00100000:0.0:1789578862.950499:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789578862.951146:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578862.951191:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578862.951204:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277077888:0@lo:13: 00000100:00100000:2.0:1789578862.951252:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.951401:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077760 00000100:00100000:2.0:1789578862.951408:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077760 00000100:00100000:2.0:1789578862.951454:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277077888 00000100:00100000:2.0:1789578862.951457:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277077888 00000100:00100000:2.0:1789578862.951475:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789578862.951484:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277077760:12345-0@lo:13: 00002000:00000024:2.0:1789578862.951504:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578862.951544:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277077760:12345-0@lo:13: Request processed in 60us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578862.951550:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789578862.951568:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789578862.951575:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277077888:12345-0@lo:13: 00002000:00000024:2.0:1789578862.951599:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578862.951633:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277077888:12345-0@lo:13: Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578862.951639:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789578862.951654:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578862.951657:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789578862.951680:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4c700 x1876509277077888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578862.951699:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277077888:0@lo:13: 00000100:00100000:2.0:1789578862.952295:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277078144:0@lo:400: 00000100:00100000:2.0:1789578862.952331:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952374:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277078656:0@lo:400: 00000100:00100000:2.0:1789578862.952400:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952417:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277079168:0@lo:400: 00000100:00100000:2.0:1789578862.952437:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952454:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789578862.952460:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277078272:0@lo:400: 00000100:00100000:2.0:1789578862.952485:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952501:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277078784:0@lo:400: 00000100:00100000:2.0:1789578862.952518:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952540:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277078016:0@lo:400: 00000100:00100000:2.0:1789578862.952563:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952586:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277078528:0@lo:400: 00000100:00100000:2.0:1789578862.952603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952615:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277079040:0@lo:400: 00000100:00100000:2.0:1789578862.952641:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952653:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789578862.952658:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277078400:0@lo:400: 00000100:00100000:2.0:1789578862.952677:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952687:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277078912:0@lo:400: 00000100:00100000:2.0:1789578862.952707:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578862.952731:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078016 00000100:00100000:2.0:1789578862.952737:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078016 00000100:00100000:2.0:1789578862.952777:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789578862.952784:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277078016:12345-0@lo:400: 00000100:00100000:2.0:1789578862.952819:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277078016:12345-0@lo:400: Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578862.952825:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789578862.952860:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277078016:0@lo:400: 00000100:00100000:0.0:1789578862.955574:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078144 00000100:00100000:0.0:1789578862.955589:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078144 00000100:00100000:0.0:1789578862.955632:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078656 00000100:00100000:0.0:1789578862.955635:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078656 00000100:00100000:0.0:1789578862.955668:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079168 00000100:00100000:0.0:1789578862.955671:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079168 00000100:00100000:0.0:1789578862.955686:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078784 00000100:00100000:0.0:1789578862.955689:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078784 00000100:00100000:0.0:1789578862.955701:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079040 00000100:00100000:0.0:1789578862.955704:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079040 00000100:00100000:0.0:1789578862.955715:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078400 00000100:00100000:0.0:1789578862.955718:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078400 00000100:00100000:0.0:1789578862.955766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578862.955776:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277078144:12345-0@lo:400: 00000100:00100000:0.0:1789578862.955865:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277078144:12345-0@lo:400: Request processed in 91us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.955872:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578862.955889:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578862.955896:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277078656:12345-0@lo:400: 00000100:00100000:0.0:1789578862.955926:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277078656:12345-0@lo:400: Request processed in 31us (3524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.955932:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578862.955944:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578862.955951:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277079168:12345-0@lo:400: 00000100:00100000:0.0:1789578862.955978:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277079168:12345-0@lo:400: Request processed in 28us (3540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.955984:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578862.955995:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789578862.956007:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277078784:12345-0@lo:400: 00000100:00100000:0.0:1789578862.956041:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277078784:12345-0@lo:400: Request processed in 34us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.956046:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789578862.956058:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578862.956063:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277079040:12345-0@lo:400: 00000100:00100000:0.0:1789578862.956091:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277079040:12345-0@lo:400: Request processed in 28us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.956096:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578862.956107:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789578862.956112:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277078400:12345-0@lo:400: 00000100:00100000:0.0:1789578862.956134:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277078400:12345-0@lo:400: Request processed in 23us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.956139:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789578862.956159:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078272 00000100:00100000:0.0:1789578862.956163:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078272 00000100:00100000:0.0:1789578862.956184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078528 00000100:00100000:0.0:1789578862.956187:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078528 00000100:00100000:0.0:1789578862.956200:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578862.956206:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277078272:12345-0@lo:400: 00000100:00100000:0.0:1789578862.956253:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277078272:12345-0@lo:400: Request processed in 47us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.956259:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578862.956270:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789578862.956275:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277078528:12345-0@lo:400: 00000100:00100000:0.0:1789578862.956310:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277078528:12345-0@lo:400: Request processed in 35us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578862.956321:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789578862.956342:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578862.956345:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578862.956392:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277078272:0@lo:400: 00010000:00080000:0.0:1789578862.956406:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a81880 x1876509277078784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578862.956416:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277078784:0@lo:400: 00000100:00100000:0.0:1789578862.956428:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277078144:0@lo:400: 00000100:00100000:0.0:1789578862.956438:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277078656:0@lo:400: 00010000:00080000:0.0:1789578862.956447:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a80700 x1876509277079168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578862.956456:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277079168:0@lo:400: 00000100:00100000:0.0:1789578862.956495:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277078400:0@lo:400: 00000100:00100000:0.0:1789578862.956504:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277078528:0@lo:400: 00000100:00100000:0.0:1789578862.956514:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277079040:0@lo:400: 00010000:00080000:0.0:1789578862.956543:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16d80 x1876509277077760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578862.956561:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277077760:0@lo:13: 00000100:00100000:3.0:1789578862.956907:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277078912 00000100:00100000:3.0:1789578862.956913:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277078912 00000100:00100000:3.0:1789578862.957061:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789578862.957070:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277078912:12345-0@lo:400: 00000100:00100000:3.0:1789578862.957117:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277078912:12345-0@lo:400: Request processed in 49us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578862.957123:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789578862.957233:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789578862.957254:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a80380 x1876509277078912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578862.957266:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277078912:0@lo:400: 00000100:00100000:0.0:1789578862.959727:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789578862.959752:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277079296:0@lo:13: 00000100:00100000:0.0:1789578862.959825:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578862.959924:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079296 00000100:00100000:3.0:1789578862.959931:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079296 00000100:00100000:3.0:1789578862.959975:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789578862.959983:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277079296:12345-0@lo:13: 00002000:00000024:3.0:1789578862.960004:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578862.960054:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277079296:12345-0@lo:13: Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578862.960060:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789578862.960129:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350c380 x1876509277079296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578862.960148:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277079296:0@lo:13: 00010000:00010000:0.0:1789578863.715672:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578863.971763:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578863.971793:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277079424:0@lo:41: 00000100:00100000:2.0:1789578863.971870:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578863.971987:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079424 00000100:00100000:1.0:1789578863.971995:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079424 00000100:00100000:1.0:1789578863.972048:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789578863.972057:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277079424:12345-0@lo:41: 00000004:00000024:1.0:1789578863.972087:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578863.972143:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277079424:12345-0@lo:41: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578863.972150:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789578863.972193:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277079424:0@lo:41: 00000100:00100000:2.0:1789578863.972564:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277079552:0@lo:41: 00000100:00100000:2.0:1789578863.972607:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578863.973766:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079552 00000100:00100000:3.0:1789578863.973777:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079552 00000100:00100000:3.0:1789578863.973815:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789578863.973832:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277079552:12345-0@lo:41: 00000004:00000024:3.0:1789578863.973865:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789578863.973935:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277079552:12345-0@lo:41: Request processed in 104us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578863.973942:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789578863.974095:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277079552:0@lo:41: 00000001:00100000:0.0:1789578863.978307:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000001:00080000:0.0:1789578863.978322:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1789578864.740337:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578864.761007:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578864.761050:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578864.761082:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578864.761110:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578864.761146:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578864.761174:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304192 00000100:00100000:0.0:1789578864.761184:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304192 00000100:00100000:0.0:1789578864.761235:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304320 00000100:00100000:0.0:1789578864.761239:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304320 00000100:00100000:0.0:1789578864.761262:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789578864.761283:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261304192:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578864.761382:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261304192:12345-192.168.203.37@tcp:400: Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578864.761390:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789578864.761408:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789578864.761415:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261304320:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578864.761440:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261304320:12345-192.168.203.37@tcp:400: Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578864.761447:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789578864.761464:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303936 00000100:00100000:0.0:1789578864.761468:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303936 00000100:00100000:0.0:1789578864.761494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304064 00000100:00100000:0.0:1789578864.761497:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304064 00000100:00100000:0.0:1789578864.761517:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789578864.761523:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261303936:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578864.761563:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261303936:12345-192.168.203.37@tcp:400: Request processed in 39us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578864.761570:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789578864.761583:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789578864.761589:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261304064:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578864.761612:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261304064:12345-192.168.203.37@tcp:400: Request processed in 23us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578864.761631:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789578864.761790:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261303808 00000100:00100000:0.0:1789578864.761795:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261303808 00000100:00100000:0.0:1789578864.761820:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:0.0:1789578864.761827:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261303808:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578864.761853:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261303808:12345-192.168.203.37@tcp:400: Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578864.761859:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00080000:3.0:1789578864.762237:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578864.762242:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578864.762244:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578864.762246:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789578864.921561:0:10159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1789578865.002399:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000001:00100000:1.0:1789578865.002487:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00010000:00010000:1.0:1789578865.773712:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789578866.029330:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00010000:00010000:2.0:1789578866.791549:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578867.811562:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578868.067735:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277080064:0@lo:400: 00000100:00100000:2.0:1789578868.067832:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.067893:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277080576:0@lo:400: 00000100:00100000:2.0:1789578868.067919:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.067954:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277081088:0@lo:400: 00000100:00100000:2.0:1789578868.067977:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.068005:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789578868.068011:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277079936:0@lo:400: 00000100:00100000:2.0:1789578868.068036:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.068055:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277080448:0@lo:400: 00000100:00100000:2.0:1789578868.068073:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.068086:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277080960:0@lo:400: 00000100:00100000:2.0:1789578868.068105:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.068138:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079936 00000100:00100000:2.0:1789578868.068147:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079936 00000100:00100000:2.0:1789578868.068198:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789578868.068208:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277079936:12345-0@lo:400: 00000100:00100000:2.0:1789578868.068267:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277079936:12345-0@lo:400: Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578868.068290:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789578868.068345:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277079936:0@lo:400: 00000100:00100000:0.0:1789578868.068555:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277079808:0@lo:400: 00000100:00100000:0.0:1789578868.068587:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068611:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277080320:0@lo:400: 00000100:00100000:0.0:1789578868.068633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068643:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277080832:0@lo:400: 00000100:00100000:0.0:1789578868.068663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068674:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277081344:0@lo:13: 00000100:00100000:0.0:1789578868.068714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068752:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789578868.068758:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277079680:0@lo:400: 00000100:00100000:0.0:1789578868.068785:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068812:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277080192:0@lo:400: 00000100:00100000:0.0:1789578868.068848:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068871:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277080704:0@lo:400: 00000100:00100000:0.0:1789578868.068894:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068913:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277081216:0@lo:400: 00000100:00100000:0.0:1789578868.068930:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.068962:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080064 00000100:00100000:0.0:1789578868.068966:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080064 00000100:00100000:0.0:1789578868.068996:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080448 00000100:00100000:0.0:1789578868.068998:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080448 00000100:00100000:0.0:1789578868.069038:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080960 00000100:00100000:0.0:1789578868.069041:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080960 00000100:00100000:0.0:1789578868.069055:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079808 00000100:00100000:0.0:1789578868.069057:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079808 00000100:00100000:0.0:1789578868.069067:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080320 00000100:00100000:0.0:1789578868.069069:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080320 00000100:00100000:0.0:1789578868.069079:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080832 00000100:00100000:0.0:1789578868.069082:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080832 00000100:00100000:0.0:1789578868.069094:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789578868.069101:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277080064:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069145:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277080064:12345-0@lo:400: Request processed in 44us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069151:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789578868.069166:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578868.069173:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277080448:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069209:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277080448:12345-0@lo:400: Request processed in 37us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069215:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578868.069226:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789578868.069233:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277080960:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069259:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277080960:12345-0@lo:400: Request processed in 27us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069265:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789578868.069274:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789578868.069280:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277079808:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069311:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277079808:12345-0@lo:400: Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789578868.069328:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789578868.069334:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277080320:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069389:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277080320:12345-0@lo:400: Request processed in 55us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069395:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789578868.069407:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578868.069413:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277080832:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069440:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277080832:12345-0@lo:400: Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069445:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578868.069464:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080576 00000100:00100000:0.0:1789578868.069468:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080576 00000100:00100000:0.0:1789578868.069490:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081088 00000100:00100000:0.0:1789578868.069500:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081088 00000100:00100000:0.0:1789578868.069518:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080704 00000100:00100000:0.0:1789578868.069520:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080704 00000100:00100000:0.0:1789578868.069531:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081216 00000100:00100000:0.0:1789578868.069534:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081216 00000100:00100000:0.0:1789578868.069545:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578868.069550:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277080576:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069584:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277080576:12345-0@lo:400: Request processed in 34us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069590:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789578868.069601:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789578868.069607:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277081088:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069637:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277081088:12345-0@lo:400: Request processed in 30us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069642:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789578868.069652:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789578868.069658:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277080704:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069701:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277080704:12345-0@lo:400: Request processed in 42us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069707:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789578868.069729:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578868.069736:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277081216:12345-0@lo:400: 00000100:00100000:0.0:1789578868.069762:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277081216:12345-0@lo:400: Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069767:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789578868.069839:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081344 00000100:00100000:0.0:1789578868.069843:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081344 00000100:00100000:0.0:1789578868.069870:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578868.069884:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277081344:12345-0@lo:13: 00002000:00000024:0.0:1789578868.069911:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578868.069944:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277081344:12345-0@lo:13: Request processed in 62us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.069950:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578868.069971:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277079680 00000100:00100000:0.0:1789578868.069975:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277079680 00000100:00100000:0.0:1789578868.070001:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789578868.070006:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277079680:12345-0@lo:400: 00000100:00100000:0.0:1789578868.070036:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277079680:12345-0@lo:400: Request processed in 30us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.070042:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789578868.070074:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277080192 00000100:00100000:0.0:1789578868.070078:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277080192 00000100:00100000:0.0:1789578868.070101:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789578868.070107:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277080192:12345-0@lo:400: 00000100:00100000:0.0:1789578868.070139:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277080192:12345-0@lo:400: Request processed in 31us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.070144:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789578868.070171:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789578868.070176:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578868.070179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578868.070181:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789578868.070202:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277081472:0@lo:13: 00000100:00100000:0.0:1789578868.070229:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578868.070265:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081472 00000100:00100000:0.0:1789578868.070269:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081472 00000100:00100000:0.0:1789578868.070290:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578868.070304:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277081472:12345-0@lo:13: 00002000:00000024:0.0:1789578868.070315:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578868.070346:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277081472:12345-0@lo:13: Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578868.070376:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789578868.070412:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a48000 x1876509277081472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070433:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277081472:0@lo:13: 00000100:00100000:0.0:1789578868.070470:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277079680:0@lo:400: 00000100:00100000:0.0:1789578868.070480:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277080192:0@lo:400: 00010000:00080000:0.0:1789578868.070490:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5d180 x1876509277080704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070498:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277080704:0@lo:400: 00010000:00080000:0.0:1789578868.070508:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5df80 x1876509277081216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070515:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789578868.070527:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277081216:0@lo:400: 00000100:00100000:0.0:1789578868.070538:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277079808:0@lo:400: 00000100:00100000:0.0:1789578868.070547:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277080320:0@lo:400: 00000100:00100000:0.0:1789578868.070557:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277080832:0@lo:400: 00010000:00080000:0.0:1789578868.070564:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437357100 x1876509277081344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070586:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277081344:0@lo:13: 00010000:00080000:0.0:1789578868.070645:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a81f80 x1876509277080448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070654:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277080448:0@lo:400: 00010000:00080000:0.0:1789578868.070664:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5ca80 x1876509277080960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070671:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277080960:0@lo:400: 00000100:00100000:0.0:1789578868.070682:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277080064:0@lo:400: 00010000:00080000:0.0:1789578868.070692:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4c700 x1876509277080576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070700:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277080576:0@lo:400: 00010000:00080000:0.0:1789578868.070708:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5d500 x1876509277081088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578868.070714:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277081088:0@lo:400: 00000100:00100000:2.0:1789578868.072212:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578868.072239:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277081600:0@lo:13: 00000100:00100000:2.0:1789578868.072332:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578868.072411:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081600 00000100:00100000:2.0:1789578868.072420:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081600 00000100:00100000:2.0:1789578868.072471:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789578868.072479:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277081600:12345-0@lo:13: 00002000:00000024:2.0:1789578868.072511:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578868.072559:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277081600:12345-0@lo:13: Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578868.072581:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789578868.072635:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5c700 x1876509277081600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578868.072654:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277081600:0@lo:13: 00000100:00100000:1.0:1789578868.073640:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277081728:0@lo:13: 00000100:00100000:1.0:1789578868.073698:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.073932:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277081728 00000100:00100000:3.0:1789578868.073939:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277081728 00000100:00100000:3.0:1789578868.073985:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789578868.073995:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277081728:12345-0@lo:13: 00002000:00000024:3.0:1789578868.074018:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578868.078752:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277081728:12345-0@lo:13: Request processed in 4743us (5037us total) trans 0 rc 0/0 00010000:00080000:1.0:1789578868.079143:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5c700 x1876509277081728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578868.079177:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277081728:0@lo:13: 00000100:00100000:3.0:1789578868.079555:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:3.0:1789578868.694332:0:10306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe759fd2a0 20000000:00000080:3.0:1789578868.694380:0:10306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939437396c00 uarg=0000000000000000 20000000:01000000:3.0:1789578868.694456:0:10306:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789578868.694459:0:10306:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789578868.694463:0:10306:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789578868.694470:0:10306:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789578868.694477:0:10306:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789578868.694552:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789578868.694555:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789578868.701194:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789578868.702216:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789578868.702279:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789578868.702296:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789578868.702307:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789578868.702311:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789578868.704244:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789578868.704576:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789578868.704614:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789578868.704633:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789578868.704659:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789578868.704663:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789578868.705309:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789578868.705587:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789578868.705613:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789578868.705626:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789578868.705635:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789578868.705648:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789578868.706195:0:10310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789578868.706452:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789578868.706480:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789578868.706495:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1789578868.706508:0:10306:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789578868.706510:0:10306:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789578868.712425:0:10311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789578868.713599:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789578868.713727:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789578868.713750:0:10306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1789578868.713772:0:10306:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789578868.713797:0:10306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713820:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713829:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20bca expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713837:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c09 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713843:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713850:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c25 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713859:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c41 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713873:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c6b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713880:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20c87 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713887:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713899:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713907:0:10306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713915:0:10306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713967:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.713988:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 9 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714007:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277081856:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578868.714312:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714322:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714337:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277081984:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578868.714453:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714463:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 23 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714473:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082112:0@lo:104: 00000100:00100000:3.0:1789578868.714535:0:10306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578868.714575:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714584:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 23 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714593:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082240:0@lo:104: 00000100:00100000:3.0:1789578868.714615:0:10306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578868.714661:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714669:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 23 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714678:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082368:0@lo:104: 00000100:00100000:3.0:1789578868.714699:0:10306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578868.714740:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714762:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 23 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714770:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082496:0@lo:104: 00000100:00100000:3.0:1789578868.714797:0:10306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578868.714821:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714830:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 23 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714837:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082624:0@lo:104: 00010000:00010000:3.0:1789578868.714894:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714903:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714911:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082752:0@lo:104: 00010000:00010000:3.0:1789578868.714937:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714944:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 23 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.714952:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082880:0@lo:104: 00010000:00010000:3.0:1789578868.714976:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.714994:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 23 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.715003:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277083008:0@lo:104: 00010000:00010000:3.0:1789578868.715026:0:10306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.715033:0:10306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 23 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.715041:0:10306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277083136:0@lo:104: 00000100:00100000:3.0:1789578868.715056:0:10306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789578868.715408:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789578868.715431:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.715444:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.715452:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.715460:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.715475:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.715484:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082112 00000100:00100000:1.0:1789578868.715492:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082112 00000100:00100000:1.0:1789578868.715548:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082240 00000100:00100000:1.0:1789578868.715551:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082240 00000100:00100000:1.0:1789578868.715562:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082368 00000100:00100000:1.0:1789578868.715564:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082368 00000100:00100000:1.0:1789578868.715572:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082496 00000100:00100000:1.0:1789578868.715574:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082496 00000100:00100000:1.0:1789578868.715581:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082624 00000100:00100000:1.0:1789578868.715583:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082624 00000100:00100000:1.0:1789578868.715590:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082752 00000100:00100000:1.0:1789578868.715592:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082752 00000100:00100000:1.0:1789578868.715600:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277082880 00000100:00100000:1.0:1789578868.715601:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277082880 00000100:00100000:1.0:1789578868.715609:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083008 00000100:00100000:1.0:1789578868.715610:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083008 00000100:00100000:1.0:1789578868.715617:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083136 00000100:00100000:1.0:1789578868.715619:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083136 00000100:00100000:1.0:1789578868.715631:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789578868.715649:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+11:10306:x1876509277082112:12345-0@lo:104: 00010000:00010000:1.0:1789578868.715668:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.715740:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578868.715746:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+11:10306:x1876509277082112:12345-0@lo:104: Request processed in 107us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.715753:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789578868.715771:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789578868.715776:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:10306:x1876509277082240:12345-0@lo:104: 00010000:00010000:1.0:1789578868.715784:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.715822:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789578868.715826:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+10:10306:x1876509277082240:12345-0@lo:104: Request processed in 50us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.715832:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789578868.715843:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789578868.715847:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:10306:x1876509277082368:12345-0@lo:104: 00010000:00010000:1.0:1789578868.715855:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.715884:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789578868.715888:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+9:10306:x1876509277082368:12345-0@lo:104: Request processed in 41us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.715893:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789578868.715902:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789578868.715907:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302899c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+8:10306:x1876509277082496:12345-0@lo:104: 00010000:00010000:1.0:1789578868.715914:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.715933:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789578868.715938:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302899c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+8:10306:x1876509277082496:12345-0@lo:104: Request processed in 31us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.715943:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789578868.715972:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789578868.715977:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+7:10306:x1876509277082624:12345-0@lo:104: 00010000:00010000:1.0:1789578868.715984:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.716010:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789578868.716015:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+7:10306:x1876509277082624:12345-0@lo:104: Request processed in 38us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.716020:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789578868.716030:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789578868.716035:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+6:10306:x1876509277082752:12345-0@lo:104: 00010000:00010000:1.0:1789578868.716041:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.716059:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789578868.716063:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+6:10306:x1876509277082752:12345-0@lo:104: Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.716067:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789578868.716076:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578868.716081:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+5:10306:x1876509277082880:12345-0@lo:104: 00010000:00010000:1.0:1789578868.716087:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578868.716379:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789578868.716392:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:10306:x1876509277083008:12345-0@lo:104: 00010000:00010000:2.0:1789578868.716403:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.716440:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789578868.716445:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:10306:x1876509277083008:12345-0@lo:104: Request processed in 59us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578868.716450:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789578868.716464:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789578868.716469:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:10306:x1876509277083136:12345-0@lo:104: 00010000:00010000:2.0:1789578868.716486:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.716514:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1789578868.716519:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:10306:x1876509277083136:12345-0@lo:104: Request processed in 50us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578868.716525:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789578868.716618:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1789578868.716623:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:10306:x1876509277082880:12345-0@lo:104: Request processed in 542us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.716629:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789578868.716781:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082112:0@lo:104: 00000100:00100000:3.0:1789578868.716793:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082240:0@lo:104: 00000100:00100000:3.0:1789578868.716800:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082368:0@lo:104: 00000100:00100000:3.0:1789578868.716808:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082496:0@lo:104: 00000100:00100000:3.0:1789578868.716816:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082624:0@lo:104: 00000100:00100000:3.0:1789578868.716822:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082752:0@lo:104: 00000100:00100000:3.0:1789578868.716830:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277082880:0@lo:104: 00000100:00100000:3.0:1789578868.716835:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277083008:0@lo:104: 00000100:00100000:3.0:1789578868.716841:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277083136:0@lo:104: 00010000:00010000:1.0:1789578868.716889:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1789578868.716896:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.716915:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789578868.716920:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.716930:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578868.716938:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578868.716943:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789578868.717031:0:9493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.717038:0:9493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578868.717066:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.717074:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f20cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20cb8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.717091:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1789578868.717095:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.717100:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789578868.717112:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.717130:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578868.717137:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578868.717143:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789578868.717372:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789578868.717379:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578868.717386:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789578868.717390:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578868.717407:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578868.717414:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578868.717420:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789578868.717543:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277083264:0@lo:103: 00000100:00100000:3.0:1789578868.717591:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578868.718429:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789578868.719551:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789578868.719659:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719680:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.719684:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719695:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.719702:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.719708:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.719778:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719786:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.719834:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719842:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519800/0xd90373d592f20c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c48 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719858:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789578868.719862:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719868:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.719871:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719889:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.719895:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.719900:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.719914:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719919:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.719924:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719931:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af200/0xd90373d592f20c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c1e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719940:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789578868.719944:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719949:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aec00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.719952:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719959:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.719966:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.719976:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.719990:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.719996:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.720010:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720017:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bd1 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720026:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789578868.720030:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720036:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2ea00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.720039:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720045:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.720050:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.720056:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.720068:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720074:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.720086:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720093:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2ea00/0xd90373d592f20ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20ba7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720114:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578868.720118:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720124:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.720127:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720134:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.720141:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.720147:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.720160:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720175:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.720179:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720186:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401518c00/0xd90373d592f20c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c10 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720197:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578868.720206:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578868.720208:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578868.720231:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083392:0@lo:103: 00000100:00100000:3.0:1789578868.720327:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.720418:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083904:0@lo:103: 00000100:00100000:3.0:1789578868.720440:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.720468:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578868.720473:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083520:0@lo:103: 00000100:00100000:3.0:1789578868.720492:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.720532:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277083648:0@lo:103: 00000100:00100000:3.0:1789578868.720555:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.720567:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578868.720571:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277083776:0@lo:103: 00000100:00100000:3.0:1789578868.720588:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.720615:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083264 00000100:00100000:3.0:1789578868.720624:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083264 00010000:00010000:3.0:1789578868.720660:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 24 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720684:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083392 00000100:00100000:3.0:1789578868.720686:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083392 00010000:00010000:3.0:1789578868.720697:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 25 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720707:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083904 00000100:00100000:3.0:1789578868.720710:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083904 00010000:00010000:3.0:1789578868.720732:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 26 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720743:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083520 00000100:00100000:3.0:1789578868.720751:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083520 00010000:00010000:3.0:1789578868.720765:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 27 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720776:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083648 00000100:00100000:3.0:1789578868.720778:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083648 00010000:00010000:3.0:1789578868.720788:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 28 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720799:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277083776 00000100:00100000:3.0:1789578868.720801:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277083776 00010000:00010000:3.0:1789578868.720810:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 29 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.720823:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789578868.720831:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+29:3618:x1876509277083264:12345-0@lo:103: 00010000:00010000:3.0:1789578868.720847:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.720853:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 29 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720865:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 29 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720881:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518400/0xd90373d592f20cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20cb1 expref: 29 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.720896:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.720936:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+28:3618:x1876509277083264:12345-0@lo:103: Request processed in 104us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.720944:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789578868.720994:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789578868.721007:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+27:3615:x1876509277083392:12345-0@lo:103: 00010000:00010000:3.0:1789578868.721015:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.721020:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 27 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721029:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 27 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721038:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518a00/0xd90373d592f20c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c41 expref: 27 pid: 6484 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721047:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.721073:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+26:3615:x1876509277083392:12345-0@lo:103: Request processed in 68us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.721079:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789578868.721090:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789578868.721096:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3615:x1876509277083904:12345-0@lo:103: 00010000:00010000:3.0:1789578868.721103:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.721107:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 25 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721115:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 25 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721125:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af600/0xd90373d592f20c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c09 expref: 25 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721132:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.721153:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277083904:12345-0@lo:103: Request processed in 57us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.721168:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789578868.721181:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789578868.721186:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3615:x1876509277083520:12345-0@lo:103: 00010000:00010000:3.0:1789578868.721194:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.721198:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721207:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721217:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae200/0xd90373d592f20c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c17 expref: 23 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721225:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.721247:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3615:x1876509277083520:12345-0@lo:103: Request processed in 62us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.721253:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789578868.721265:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789578868.721271:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3617:x1876509277083648:12345-0@lo:103: 00010000:00010000:3.0:1789578868.721278:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.721282:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 21 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721290:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 21 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721300:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2ec00/0xd90373d592f20bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20bca expref: 21 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721321:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.721389:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3617:x1876509277083648:12345-0@lo:103: Request processed in 78us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.721395:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789578868.721407:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789578868.721412:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3617:x1876509277083776:12345-0@lo:103: 00010000:00010000:3.0:1789578868.721419:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.721423:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 19 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721430:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 19 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721438:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aee00/0xd90373d592f20ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20ba0 expref: 19 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.721446:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.721467:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3617:x1876509277083776:12345-0@lo:103: Request processed in 55us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.721472:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789578868.721518:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277083264:0@lo:103: 00000100:00100000:3.0:1789578868.721548:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083520:0@lo:103: 00000100:00100000:3.0:1789578868.721555:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083392:0@lo:103: 00000100:00100000:3.0:1789578868.721561:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277083904:0@lo:103: 00000100:00100000:3.0:1789578868.721581:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277083776:0@lo:103: 00000100:00100000:3.0:1789578868.721598:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277083648:0@lo:103: 00010000:00010000:1.0:1789578868.722399:0:9493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722411:0:9493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578868.722427:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722434:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519400/0xd90373d592f20c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c8e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722448:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578868.722450:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578868.722452:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578868.722469:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277084032:0@lo:103: 00000100:00100000:1.0:1789578868.722513:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578868.722586:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084032 00000100:00100000:1.0:1789578868.722592:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084032 00010000:00010000:1.0:1789578868.722619:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 18 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578868.722651:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578868.722658:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:3616:x1876509277084032:12345-0@lo:103: 00010000:00010000:1.0:1789578868.722677:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578868.722682:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 18 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722692:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 18 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722703:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f400/0xd90373d592f20c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c87 expref: 18 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.722725:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578868.722752:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3616:x1876509277084032:12345-0@lo:103: Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.722758:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578868.722785:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277084032:0@lo:103: 00010000:00010000:0.0:1789578868.723052:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578868.723061:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578868.723074:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578868.723082:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519a00/0xd90373d592f20c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c72 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578868.723092:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578868.723093:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578868.723095:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578868.723241:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277084160:0@lo:103: 00000100:00100000:0.0:1789578868.723273:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.723676:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084160 00000100:00100000:3.0:1789578868.723682:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084160 00010000:00010000:3.0:1789578868.723709:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 17 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.723745:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789578868.723751:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:3617:x1876509277084160:12345-0@lo:103: 00010000:00010000:3.0:1789578868.723763:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.723766:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 17 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.723775:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 17 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.723787:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e600/0xd90373d592f20c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c6b expref: 17 pid: 6485 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.723798:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.723830:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3617:x1876509277084160:12345-0@lo:103: Request processed in 79us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.723836:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789578868.724236:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277084160:0@lo:103: 00010000:00010000:2.0:1789578868.724590:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578868.724593:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578868.724595:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578868.724814:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.724825:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789578868.724830:0:10312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.724853:0:10312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789578868.724860:0:10312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578868.724865:0:10312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789578868.724942:0:10312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.724949:0:10312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789578868.724980:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.724989:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401518e00/0xd90373d592f20c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20c2c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.725009:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578868.725011:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578868.725013:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578868.725049:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578868.725065:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277084288:0@lo:103: 00000100:00100000:1.0:1789578868.725303:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578868.725438:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084288 00000100:00100000:3.0:1789578868.725445:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084288 00010000:00010000:3.0:1789578868.725473:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 16 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.725508:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789578868.725568:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+16:3617:x1876509277084288:12345-0@lo:103: 00010000:00010000:3.0:1789578868.725582:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578868.725588:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 16 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.725606:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 16 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.725622:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437000/0xd90373d592f20c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20c25 expref: 16 pid: 6482 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.725637:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578868.725752:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+15:3617:x1876509277084288:12345-0@lo:103: Request processed in 236us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578868.725760:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578868.725899:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277084288:0@lo:103: 00000100:00100000:2.0:1789578868.728159:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277081856:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578868.728187:0:10306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10306:1876509277081984:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578868.728260:0:10306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578868.729489:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578868.730183:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304448 00000100:00100000:1.0:1789578868.730198:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304448 00010000:00010000:1.0:1789578868.730254:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 10 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578868.730317:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:1.0:1789578868.730330:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261304448:12345-192.168.203.37@tcp:103: 00010000:00010000:1.0:1789578868.730368:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578868.730396:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 10 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.730412:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 10 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.730439:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518000/0xd90373d592f20ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd85 expref: 10 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578868.730460:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578868.730883:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:2393:x1876509261304448:12345-192.168.203.37@tcp:103: Request processed in 552us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578868.731842:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789578868.744145:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578868.744289:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304576 00000100:00100000:1.0:1789578868.744303:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304576 00010000:00010000:1.0:1789578868.744405:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578868.744455:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:2.0:1789578868.745018:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:2392:x1876509261304576:12345-192.168.203.37@tcp:103: 00010000:00010000:2.0:1789578868.745043:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578868.745051:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745068:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745178:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f800/0xd90373d592f20cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebd7e expref: 9 pid: 6485 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745231:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745240:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745261:0:9492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745268:0:9492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745275:0:9492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745282:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745288:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789578868.745292:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745300:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745328:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.745340:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578868.745543:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:2392:x1876509261304576:12345-192.168.203.37@tcp:103: Request processed in 1077us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578868.745559:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00010000:00010000:3.0:1789578868.745608:0:10306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.745620:0:10306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578868.745628:0:10306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687000/0xd90373d592f20d0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578868.836346:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578869.091721:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578869.091769:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277084416:0@lo:41: 00000100:00100000:0.0:1789578869.091863:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578869.092055:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084416 00000100:00100000:1.0:1789578869.092067:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084416 00000100:00100000:1.0:1789578869.092150:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789578869.092164:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277084416:12345-0@lo:41: 00000004:00000024:1.0:1789578869.092210:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578869.092268:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277084416:12345-0@lo:41: Request processed in 108us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578869.092276:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789578869.092561:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277084416:0@lo:41: 00000100:00100000:0.0:1789578869.093870:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277084544:0@lo:41: 00000100:00100000:0.0:1789578869.093956:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578869.094091:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084544 00000100:00100000:2.0:1789578869.094100:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084544 00000100:00100000:2.0:1789578869.094164:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789578869.094175:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277084544:12345-0@lo:41: 00000004:00000024:2.0:1789578869.094212:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578869.094268:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277084544:12345-0@lo:41: Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.094275:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789578869.094647:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277084544:0@lo:41: 00010000:00010000:1.0:1789578869.861816:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578869.878108:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.881285:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304704 00000100:00100000:0.0:1789578869.881307:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304704 00000100:00100000:0.0:1789578869.881438:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:0.0:1789578869.881451:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:6165:x1876509261304704:12345-192.168.203.37@tcp:101: 00010000:00010000:0.0:1789578869.881475:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578869.881501:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436e00/0xd90373d592f20d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebdf5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578869.881540:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436e00/0xd90373d592f20d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdf5 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578869.881553:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436e00/0xd90373d592f20d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdf5 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578869.881564:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436e00, rc 0) 00000100:00100000:0.0:1789578869.881657:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261304704:12345-192.168.203.37@tcp:101: Request processed in 208us (3562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578869.881665:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:0.0:1789578869.891681:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.891743:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578869.891964:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305216 00000100:00100000:1.0:1789578869.891979:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305216 00000100:00100000:1.0:1789578869.892098:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:1.0:1789578869.892113:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261305216:12345-192.168.203.37@tcp:400: 00000100:00100000:1.0:1789578869.892219:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261305216:12345-192.168.203.37@tcp:400: Request processed in 109us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578869.892227:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00080000:3.0:1789578869.892343:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578869.892633:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.892676:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.892719:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.892749:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.892772:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305344 00000100:00100000:0.0:1789578869.892786:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305344 00000100:00100000:2.0:1789578869.892970:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304960 00000100:00100000:2.0:1789578869.892976:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304960 00000100:00100000:2.0:1789578869.893023:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305088 00000100:00100000:2.0:1789578869.893027:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305088 00000100:00100000:2.0:1789578869.893053:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789578869.893061:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261304960:12345-192.168.203.37@tcp:400: 00000100:00100000:2.0:1789578869.893131:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261304960:12345-192.168.203.37@tcp:400: Request processed in 70us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.893138:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789578869.893155:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:2.0:1789578869.893161:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261305088:12345-192.168.203.37@tcp:400: 00000100:00100000:2.0:1789578869.893189:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261305088:12345-192.168.203.37@tcp:400: Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.893195:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:2.0:1789578869.893302:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261304832 00000100:00100000:2.0:1789578869.893307:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261304832 00000100:00100000:2.0:1789578869.893340:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305472 00000100:00100000:2.0:1789578869.893344:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305472 00000100:00100000:2.0:1789578869.893387:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:2.0:1789578869.893395:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261304832:12345-192.168.203.37@tcp:400: 00000100:00100000:2.0:1789578869.893443:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261304832:12345-192.168.203.37@tcp:400: Request processed in 48us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.893450:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:2.0:1789578869.893476:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:2.0:1789578869.893482:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261305472:12345-192.168.203.37@tcp:501: 00000100:00100000:2.0:1789578869.893610:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261305472:12345-192.168.203.37@tcp:501: Request processed in 127us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.893617:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:0.0:1789578869.894046:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789578869.894055:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261305344:12345-192.168.203.37@tcp:400: 00000100:00100000:0.0:1789578869.894097:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261305344:12345-192.168.203.37@tcp:400: Request processed in 44us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578869.894104:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00080000:3.0:1789578869.894299:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578869.894305:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578869.894308:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578869.901265:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578869.901844:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305600 00000100:00100000:2.0:1789578869.901860:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305600 00000100:00100000:2.0:1789578869.901938:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00100000:2.0:1789578869.901951:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261305600:12345-192.168.203.37@tcp:503: 00000100:00100000:2.0:1789578869.902192:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261305600:12345-192.168.203.37@tcp:503: Request processed in 243us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.902201:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00100000:3.0:1789578869.915395:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.915807:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305728 00000100:00100000:0.0:1789578869.915824:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305728 00000100:00100000:0.0:1789578869.915905:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:0.0:1789578869.915918:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6642:x1876509261305728:12345-192.168.203.37@tcp:502: 00000100:00100000:0.0:1789578869.916143:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6642:x1876509261305728:12345-192.168.203.37@tcp:502: Request processed in 227us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578869.916152:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:3.0:1789578869.930542:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578869.930757:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305856 00000100:00100000:1.0:1789578869.930772:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305856 00000100:00100000:1.0:1789578869.930859:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:1.0:1789578869.930871:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6642:x1876509261305856:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789578869.931084:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6642:x1876509261305856:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 215us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578869.931094:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:3.0:1789578869.946042:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578869.946339:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261305984 00000100:00100000:2.0:1789578869.946388:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261305984 00000100:00100000:2.0:1789578869.946468:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:2.0:1789578869.946479:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:6165:x1876509261305984:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578869.946503:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578869.946528:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aea00/0xd90373d592f20d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebdfc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578869.946578:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aea00/0xd90373d592f20d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdfc expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578869.946590:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aea00/0xd90373d592f20d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdfc expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578869.946601:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aea00, rc 0) 00000100:00100000:2.0:1789578869.946823:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261305984:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 345us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578869.946832:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:3.0:1789578869.956670:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578869.956828:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306112 00000100:00100000:0.0:1789578869.956843:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306112 00000100:00100000:0.0:1789578869.956972:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:0.0:1789578869.956985:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306112:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578869.957161:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306112:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 178us (507us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789578869.957169:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 205 10000000:01000000:3.0:1789578870.372613:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578870.372624:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff939302b3c800 from 48 10000000:01000000:3.0:1789578870.372630:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578870.372690:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.372716:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.372732:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.372767:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084672:0@lo:101: 00000100:00100000:3.0:1789578870.375305:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.375400:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.375752:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084672 00000100:00100000:1.0:1789578870.375765:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084672 00000100:00100000:1.0:1789578870.375849:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789578870.375860:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+15:6487:x1876509277084672:12345-0@lo:101: 00010000:00010000:1.0:1789578870.375883:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578870.375907:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e400/0xd90373d592f20d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d21 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.375943:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e400/0xd90373d592f20d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d21 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.375957:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e400/0xd90373d592f20d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d21 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.375968:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e400, rc 0) 00000100:00100000:1.0:1789578870.376046:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277084672:12345-0@lo:101: Request processed in 188us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.376053:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789578870.376955:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084672:0@lo:101: 00010000:00010000:3.0:1789578870.376989:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.377004:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.377129:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084800:0@lo:501: 00000100:00100000:3.0:1789578870.377189:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.377241:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.378789:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084800 00000100:00100000:0.0:1789578870.378805:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084800 00000100:00100000:0.0:1789578870.378873:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789578870.378886:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277084800:12345-0@lo:501: 00000100:00100000:0.0:1789578870.379113:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277084800:12345-0@lo:501: Request processed in 230us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.379129:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789578870.379682:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084800:0@lo:501: 00000100:00100000:3.0:1789578870.379757:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084928:0@lo:503: 00000100:00100000:3.0:1789578870.379838:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.379885:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.379958:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277084928 00000100:00100000:1.0:1789578870.379966:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277084928 00000100:00100000:1.0:1789578870.380011:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789578870.380020:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277084928:12345-0@lo:503: 00000100:00100000:1.0:1789578870.380140:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277084928:12345-0@lo:503: Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.380148:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789578870.380193:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277084928:0@lo:503: 00000100:00100000:1.0:1789578870.380444:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10333:1876509277085056:0@lo:502: 00000100:00100000:1.0:1789578870.380481:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.380506:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085056 00000100:00100000:1.0:1789578870.380510:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085056 00000100:00100000:1.0:1789578870.380534:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789578870.380540:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10333:x1876509277085056:12345-0@lo:502: 00000100:00100000:1.0:1789578870.380624:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10333:x1876509277085056:12345-0@lo:502: Request processed in 84us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.380631:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789578870.380663:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.380675:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10333:1876509277085056:0@lo:502: 00000100:00100000:1.0:1789578870.380722:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10333:1876509277085184:0@lo:502: 00000100:00100000:1.0:1789578870.380756:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.380772:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085184 00000100:00100000:1.0:1789578870.380776:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085184 00000100:00100000:1.0:1789578870.380803:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789578870.380808:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10333:x1876509277085184:12345-0@lo:502: 00000100:00100000:1.0:1789578870.380865:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:10333:x1876509277085184:12345-0@lo:502: Request processed in 56us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.380871:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789578870.380898:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.380909:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10333:1876509277085184:0@lo:502: 00000040:00080000:1.0:1789578870.380927:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789578870.380996:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789578870.381017:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789578870.381029:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381043:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578870.381054:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789578870.381057:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789578870.381060:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789578870.381089:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381098:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381108:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.381134:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085312:0@lo:101: 00000100:00100000:1.0:1789578870.381166:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.381179:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.381192:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085312 00000100:00100000:1.0:1789578870.381195:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085312 00000100:00100000:1.0:1789578870.381215:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789578870.381221:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+16:6487:x1876509277085312:12345-0@lo:101: 00010000:00010000:1.0:1789578870.381229:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578870.381243:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2fc00/0xd90373d592f20d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d2f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381264:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2fc00/0xd90373d592f20d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d2f expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381274:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2fc00/0xd90373d592f20d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d2f expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381284:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2fc00, rc 0) 00000100:00100000:1.0:1789578870.381311:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085312:12345-0@lo:101: Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.381317:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789578870.381345:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085312:0@lo:101: 00010000:00010000:1.0:1789578870.381377:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.381387:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.381425:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085440:0@lo:501: 00000100:00100000:1.0:1789578870.381455:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.381468:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.381478:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085440 00000100:00100000:1.0:1789578870.381481:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085440 00000100:00100000:1.0:1789578870.381499:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789578870.381504:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085440:12345-0@lo:501: 00000100:00100000:1.0:1789578870.381611:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085440:12345-0@lo:501: Request processed in 105us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.381618:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789578870.381647:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085440:0@lo:501: 00000100:00100000:1.0:1789578870.381670:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085568:0@lo:503: 00000100:00100000:1.0:1789578870.381715:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.381729:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.381740:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085568 00000100:00100000:1.0:1789578870.381743:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085568 00000100:00100000:1.0:1789578870.381762:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789578870.381767:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085568:12345-0@lo:503: 00000100:00100000:1.0:1789578870.381835:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085568:12345-0@lo:503: Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.381842:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789578870.381880:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085568:0@lo:503: 00000100:00100000:1.0:1789578870.382133:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10334:1876509277085696:0@lo:502: 00000100:00100000:1.0:1789578870.382167:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.382185:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085696 00000100:00100000:1.0:1789578870.382189:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085696 00000100:00100000:1.0:1789578870.382212:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789578870.382224:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10334:x1876509277085696:12345-0@lo:502: 00000100:00100000:1.0:1789578870.382287:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10334:x1876509277085696:12345-0@lo:502: Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.382293:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789578870.382323:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.382336:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10334:1876509277085696:0@lo:502: 00000020:01000000:1.0:1789578870.382381:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578870.382391:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578870.382393:0:10334:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789578870.382399:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789578870.382422:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10334:1876509277085824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578870.382454:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.382472:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085824 00000100:00100000:1.0:1789578870.382476:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085824 00000100:00100000:1.0:1789578870.382496:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789578870.382503:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10334:x1876509277085824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578870.382558:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:10334:x1876509277085824:12345-0@lo:502:llog_process_th.0 Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.382565:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789578870.382594:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.382606:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10334:1876509277085824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789578870.382624:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578870.382629:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578870.382631:0:10334:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789578870.382634:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789578870.382690:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789578870.382722:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789578870.382735:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382746:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578870.382756:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789578870.382759:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93943711c800 from 48 10000000:01000000:1.0:1789578870.382762:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789578870.382786:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382794:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382803:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.382816:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.382840:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.382853:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.382867:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277085952 00000100:00100000:1.0:1789578870.382870:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277085952 00000100:00100000:1.0:1789578870.382891:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789578870.382897:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+17:6487:x1876509277085952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578870.382905:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578870.382916:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f400/0xd90373d592f20d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d3d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382934:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f400/0xd90373d592f20d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d3d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382952:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f400/0xd90373d592f20d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d3d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.382961:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f400, rc 0) 00000100:00100000:1.0:1789578870.382990:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277085952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.382997:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789578870.383027:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277085952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578870.383039:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.383049:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.383088:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.383108:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.383119:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.383129:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086080 00000100:00100000:1.0:1789578870.383132:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086080 00000100:00100000:1.0:1789578870.383149:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789578870.383154:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277086080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.383238:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277086080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.383244:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789578870.383269:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.383301:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.383334:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.383346:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.383391:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086208 00000100:00100000:1.0:1789578870.383396:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086208 00000100:00100000:1.0:1789578870.383415:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789578870.383421:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277086208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.383490:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277086208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.383497:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789578870.383534:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.394519:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10335:1876509277086336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.394637:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578870.394694:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408654480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.394807:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086336 00000100:00100000:1.0:1789578870.394818:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086336 00000100:00100000:1.0:1789578870.394884:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789578870.394895:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10335:x1876509277086336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578870.395057:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10335:x1876509277086336:12345-0@lo:502:llog_process_th.0 Request processed in 163us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.395077:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789578870.395446:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10335:1876509277086336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.395511:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10335:1876509277086464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.395552:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578870.395579:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408654480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.395643:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086464 00000100:00100000:3.0:1789578870.395649:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086464 00000100:00100000:3.0:1789578870.395684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789578870.395692:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10335:x1876509277086464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.395799:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+18:10335:x1876509277086464:12345-0@lo:502:llog_process_th.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.395807:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789578870.395936:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10335:1876509277086464:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789578870.395956:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789578870.396158:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789578870.396188:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789578870.396200:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396215:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578870.396226:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789578870.396230:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789578870.396233:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789578870.396267:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396275:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396284:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.396302:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.396347:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.396397:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.396415:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086592 00000100:00100000:3.0:1789578870.396420:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086592 00000100:00100000:3.0:1789578870.396451:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789578870.396458:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+18:6487:x1876509277086592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.396469:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578870.396497:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36200/0xd90373d592f20d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d4b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396524:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36200/0xd90373d592f20d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d4b expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396535:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36200/0xd90373d592f20d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d4b expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396545:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36200, rc 0) 00000100:00100000:3.0:1789578870.396577:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277086592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.396583:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789578870.396615:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.396629:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.396639:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.396691:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.396752:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.396766:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.396777:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086720 00000100:00100000:3.0:1789578870.396780:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086720 00000100:00100000:3.0:1789578870.396810:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789578870.396816:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277086720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.396938:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277086720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.396946:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789578870.396974:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.396999:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.397036:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.397050:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.397060:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086848 00000100:00100000:3.0:1789578870.397063:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086848 00000100:00100000:3.0:1789578870.397091:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789578870.397097:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277086848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.397172:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277086848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.397180:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789578870.397219:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277086848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.399314:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10336:1876509277086976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.399952:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.399993:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.400123:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277086976 00000100:00100000:3.0:1789578870.400134:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277086976 00000100:00100000:3.0:1789578870.400225:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789578870.400235:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:10336:x1876509277086976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.400443:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+19:10336:x1876509277086976:12345-0@lo:502:llog_process_th.0 Request processed in 208us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.400451:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789578870.404572:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10336:1876509277086976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789578870.404637:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578870.404655:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578870.404658:0:10336:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789578870.404666:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789578870.404734:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10336:1876509277087104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.404847:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.407456:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.412757:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087104 00000100:00100000:0.0:1789578870.412781:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087104 00000100:00100000:0.0:1789578870.415187:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789578870.415915:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:10336:x1876509277087104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.416140:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:10336:x1876509277087104:12345-0@lo:502:llog_process_th.0 Request processed in 941us (11294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.416151:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789578870.416570:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10336:1876509277087104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789578870.416620:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578870.416629:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578870.416632:0:10336:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789578870.416638:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789578870.417833:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789578870.417869:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789578870.417885:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.417900:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578870.417913:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578870.417917:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940f42d800 from 48 10000000:01000000:3.0:1789578870.417920:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578870.417966:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.417975:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.417985:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.418016:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.418681:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.418790:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940832a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789578870.419073:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087232 00000100:00100000:2.0:1789578870.419087:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087232 00000100:00100000:2.0:1789578870.419260:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789578870.419272:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+19:6487:x1876509277087232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578870.419292:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578870.419312:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363afa00/0xd90373d592f20d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d59 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.419343:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363afa00/0xd90373d592f20d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d59 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.419572:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363afa00/0xd90373d592f20d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d59 expref: 20 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.419584:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363afa00, rc 0) 00000100:00100000:2.0:1789578870.419652:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 382us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.419659:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789578870.419877:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578870.419898:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.419909:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.420004:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.420039:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.420124:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.422203:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087360 00000100:00100000:0.0:1789578870.422221:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087360 00000100:00100000:0.0:1789578870.422296:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789578870.422307:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.422550:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.422557:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789578870.423753:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.423832:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.423915:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.423957:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.424119:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087488 00000100:00100000:1.0:1789578870.424127:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087488 00000100:00100000:1.0:1789578870.424185:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789578870.424195:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.424314:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.424322:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789578870.424835:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.426026:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10337:1876509277087616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.426107:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.426242:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407daa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.426294:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087616 00000100:00100000:1.0:1789578870.426303:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087616 00000100:00100000:1.0:1789578870.426381:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789578870.426514:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10337:x1876509277087616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578870.426657:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10337:x1876509277087616:12345-0@lo:502:llog_process_th.0 Request processed in 147us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.426667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789578870.426852:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10337:1876509277087616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.426905:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10337:1876509277087744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.426945:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.426977:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410cab300 going to sleep for 11 seconds 00000100:00100000:2.0:1789578870.427017:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087744 00000100:00100000:2.0:1789578870.427023:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087744 00000100:00100000:2.0:1789578870.427058:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789578870.427065:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10337:x1876509277087744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.427216:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+20:10337:x1876509277087744:12345-0@lo:502:llog_process_th.0 Request processed in 150us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.427224:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789578870.427313:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10337:1876509277087744:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789578870.427331:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789578870.427876:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789578870.427901:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789578870.427913:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.427926:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.427939:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789578870.427942:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789578870.427946:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789578870.427980:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.427988:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.428008:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.428027:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.428061:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.428094:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.428538:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277087872 00000100:00100000:3.0:1789578870.428546:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277087872 00000100:00100000:3.0:1789578870.428586:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789578870.428594:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277087872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.428607:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578870.428623:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36400/0xd90373d592f20d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d67 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.428650:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36400/0xd90373d592f20d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d67 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.428663:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36400/0xd90373d592f20d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d67 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.428673:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36400, rc 0) 00000100:00100000:3.0:1789578870.428728:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277087872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.428736:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789578870.428870:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277087872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578870.428949:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578870.428961:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578870.429034:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.429083:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578870.429114:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394086540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.429843:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088000 00000100:00100000:3.0:1789578870.429853:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088000 00000100:00100000:3.0:1789578870.429981:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789578870.429991:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277088000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.430248:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277088000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.430256:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789578870.431154:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.431221:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.431291:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.434061:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394086540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578870.434218:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088128 00000100:00100000:2.0:1789578870.434229:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088128 00000100:00100000:2.0:1789578870.434293:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789578870.434305:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277088128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.434530:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277088128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.435057:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789578870.435151:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.435462:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10339:1876509277088256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.435528:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.435818:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088256 00000100:00100000:3.0:1789578870.435826:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088256 00000100:00100000:2.0:1789578870.435831:0:10339:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436298480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.435882:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789578870.435895:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10339:x1876509277088256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.436034:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10339:x1876509277088256:12345-0@lo:502:llog_process_th.0 Request processed in 141us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.436042:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789578870.436743:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10339:1876509277088256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789578870.436783:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578870.436795:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578870.436798:0:10339:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789578870.436805:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789578870.436841:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10339:1876509277088384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.436894:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578870.436935:0:10339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394086540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.437111:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088384 00000100:00100000:3.0:1789578870.437118:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088384 00000100:00100000:3.0:1789578870.437165:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789578870.437174:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10339:x1876509277088384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578870.437283:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10339:x1876509277088384:12345-0@lo:502:llog_process_th.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.437290:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789578870.437371:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10339:1876509277088384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789578870.437392:0:10339:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578870.437397:0:10339:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578870.437399:0:10339:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789578870.437403:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1789578870.437734:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1789578870.437770:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789578870.437783:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.437796:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578870.437820:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789578870.437823:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940679b000 from 48 10000000:01000000:3.0:1789578870.437826:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789578870.437861:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.437870:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.437880:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.437899:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.437936:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.437967:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.438023:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088512 00000100:00100000:0.0:1789578870.438029:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088512 00000100:00100000:0.0:1789578870.438064:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789578870.438072:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277088512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578870.438083:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578870.438097:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437400/0xd90373d592f20d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d75 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578870.438124:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437400/0xd90373d592f20d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d75 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578870.438137:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437400/0xd90373d592f20d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d75 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578870.438147:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437400, rc 0) 00000100:00100000:0.0:1789578870.438180:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277088512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.438186:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789578870.438253:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.438268:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.438277:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.438328:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.438381:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.438397:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.438411:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088640 00000100:00100000:3.0:1789578870.438415:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088640 00000100:00100000:3.0:1789578870.438453:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789578870.438459:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277088640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.438573:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277088640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.438581:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789578870.438609:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.438635:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.438679:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.438693:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.438718:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088768 00000100:00100000:3.0:1789578870.438722:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088768 00000100:00100000:3.0:1789578870.438738:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789578870.438743:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277088768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.438814:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277088768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.438821:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789578870.438866:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277088768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.439624:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10340:1876509277088896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.439675:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.439719:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.439946:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277088896 00000100:00100000:0.0:1789578870.439953:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277088896 00000100:00100000:0.0:1789578870.439998:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789578870.440009:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10340:x1876509277088896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.440121:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10340:x1876509277088896:12345-0@lo:502:llog_process_th.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.440129:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789578870.440519:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10340:1876509277088896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.440584:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10340:1876509277089024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.440627:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.440672:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.440690:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089024 00000100:00100000:0.0:1789578870.440696:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089024 00000100:00100000:0.0:1789578870.440744:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789578870.440752:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10340:x1876509277089024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.440850:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10340:x1876509277089024:12345-0@lo:502:llog_process_th.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.440858:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789578870.440929:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10340:1876509277089024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789578870.440950:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789578870.441127:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789578870.441150:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789578870.441161:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.441174:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.441199:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789578870.441202:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789578870.441206:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789578870.441236:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.441245:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.441256:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.441271:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.441321:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.441344:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.441465:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089152 00000100:00100000:3.0:1789578870.441471:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089152 00000100:00100000:3.0:1789578870.441505:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789578870.441513:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277089152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.441523:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578870.441557:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36a00/0xd90373d592f20d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d83 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.441583:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36a00/0xd90373d592f20d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d83 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.441595:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36a00/0xd90373d592f20d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d83 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.441604:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36a00, rc 0) 00000100:00100000:3.0:1789578870.441645:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.441652:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789578870.442001:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578870.442018:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.442028:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.442102:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.442133:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.442168:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.442478:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089280 00000100:00100000:0.0:1789578870.442484:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089280 00000100:00100000:0.0:1789578870.442526:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789578870.442536:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.442672:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.442679:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789578870.442901:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.442935:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.442978:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.443009:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.443134:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089408 00000100:00100000:0.0:1789578870.443139:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089408 00000100:00100000:0.0:1789578870.443173:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789578870.443181:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578870.443342:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.443372:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789578870.445012:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578870.448843:0:10341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10341:1876509277089536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.448951:0:10341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.449034:0:10341:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.453171:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089536 00000100:00100000:1.0:1789578870.453195:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089536 00000100:00100000:1.0:1789578870.453285:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789578870.453298:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10341:x1876509277089536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578870.454926:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10341:x1876509277089536:12345-0@lo:502:llog_process_th.0 Request processed in 1617us (5963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578870.454943:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789578870.455580:0:10341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10341:1876509277089536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789578870.455637:0:10341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578870.455650:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578870.455652:0:10341:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789578870.455660:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789578870.455725:0:10341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10341:1876509277089664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578870.455822:0:10341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.455880:0:10341:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359180 going to sleep for 11 seconds 00000100:00100000:0.0:1789578870.455910:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089664 00000100:00100000:0.0:1789578870.455919:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089664 00000100:00100000:0.0:1789578870.455988:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789578870.455999:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10341:x1876509277089664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578870.456154:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10341:x1876509277089664:12345-0@lo:502:llog_process_th.0 Request processed in 157us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578870.456161:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789578870.456421:0:10341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10341:1876509277089664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578870.456534:0:10341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578870.456544:0:10341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578870.456546:0:10341:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789578870.456551:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789578870.456691:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789578870.456726:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789578870.456748:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.456761:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578870.456772:0:6487:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789578870.456775:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93941008b380 from 1 10000000:01000000:1.0:1789578870.456778:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789578870.456811:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.456831:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.456842:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.456863:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.456901:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578870.456936:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578870.456972:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089792 00000100:00100000:3.0:1789578870.456978:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089792 00000100:00100000:3.0:1789578870.457096:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789578870.457104:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277089792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578870.457115:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578870.457130:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36000/0xd90373d592f20d98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20d91 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.457157:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36000/0xd90373d592f20d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20d91 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.457168:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36000/0xd90373d592f20d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20d91 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.457189:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36000, rc 0) 00000100:00100000:3.0:1789578870.457249:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277089792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578870.457256:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789578870.457319:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578870.457334:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.457345:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578870.457441:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578870.457469:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578870.464879:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277089920 00000100:00100000:3.0:1789578870.464899:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277089920 00000100:00100000:3.0:1789578870.464974:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789578870.464985:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277089920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578870.465153:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277089920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (7684us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789578870.465161:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789578870.466639:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578870.466764:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277089920:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789578870.466830:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789578870.466844:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578870.466857:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578870.883525:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789578870.982796:0:10370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd66947b50 20000000:00000080:3.0:1789578870.982821:0:10370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939437395000 uarg=0000000000000000 20000000:01000000:3.0:1789578870.982874:0:10370:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789578870.982882:0:10370:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789578870.982889:0:10370:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789578870.983740:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789578870.984842:0:10370:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789578870.991780:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789578870.991826:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789578870.991841:0:10370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789578870.991860:0:10370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789578870.991885:0:10370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991908:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a34 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991917:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a42 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991938:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20a96 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991945:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20bbc expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991957:0:10370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.991965:0:10370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.992019:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.992054:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 9 pid: 6485 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.992072:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090048:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578870.992208:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.992218:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 23 pid: 6484 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.992228:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090176:0@lo:104: 00000100:00100000:3.0:1789578870.994511:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578870.994659:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.994707:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 23 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.994726:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090304:0@lo:104: 00000100:00100000:3.0:1789578870.994790:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578870.994867:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.994877:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 23 pid: 6485 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.994886:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090432:0@lo:104: 00010000:00010000:3.0:1789578870.994915:0:10370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578870.994923:0:10370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 23 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.994932:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090560:0@lo:104: 00000100:00100000:3.0:1789578870.994952:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578870.995172:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789578870.995198:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.995234:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.995269:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090176 00000100:00100000:2.0:1789578870.995278:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090176 00000100:00100000:2.0:1789578870.995340:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090304 00000100:00100000:2.0:1789578870.995344:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090304 00000100:00100000:2.0:1789578870.995391:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090432 00000100:00100000:2.0:1789578870.995395:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090432 00000100:00100000:2.0:1789578870.995405:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090560 00000100:00100000:2.0:1789578870.995407:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090560 00000100:00100000:2.0:1789578870.995421:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789578870.995432:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+6:10370:x1876509277090176:12345-0@lo:104: 00010000:00010000:2.0:1789578870.995450:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995515:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789578870.995521:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+6:10370:x1876509277090176:12345-0@lo:104: Request processed in 91us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.995530:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789578870.995550:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789578870.995556:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:10370:x1876509277090304:12345-0@lo:104: 00010000:00010000:2.0:1789578870.995564:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995595:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789578870.995600:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+5:10370:x1876509277090304:12345-0@lo:104: Request processed in 44us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.995605:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789578870.995642:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578870.995649:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:10370:x1876509277090432:12345-0@lo:104: 00010000:00010000:2.0:1789578870.995656:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995711:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789578870.995717:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+4:10370:x1876509277090432:12345-0@lo:104: Request processed in 69us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.995722:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578870.995736:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789578870.995742:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:10370:x1876509277090560:12345-0@lo:104: 00010000:00010000:2.0:1789578870.995749:0:8420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995783:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789578870.995788:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+3:10370:x1876509277090560:12345-0@lo:104: Request processed in 47us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.995794:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789578870.995814:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789578870.995821:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995829:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578870.995833:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995842:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578870.995851:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.995857:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578870.995904:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995911:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578870.995934:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995941:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f20bbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20bc3 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995955:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789578870.995959:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995964:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578870.995967:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.995973:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578870.995979:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.995984:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578870.995996:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996001:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578870.996007:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996022:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f20a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a9d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996032:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789578870.996035:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996054:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401686600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578870.996056:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996062:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578870.996068:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.996073:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578870.996085:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996091:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578870.996106:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996113:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401686600/0xd90373d592f20a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a49 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996124:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578870.996132:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996138:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401686800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578870.996141:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996147:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578870.996153:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578870.996159:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578870.996172:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996178:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578870.996184:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996190:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401686800/0xd90373d592f20a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20a3b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996206:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578870.996208:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578870.996211:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578870.996220:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578870.996227:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578870.996253:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277090688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578870.996289:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.996322:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789578870.996328:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277090816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578870.996381:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.996409:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277090944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578870.996434:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.996451:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578870.996456:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277091072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578870.996479:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578870.996508:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090688 00000100:00100000:2.0:1789578870.996513:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090688 00010000:00010000:2.0:1789578870.996537:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 24 pid: 6484 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.996553:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090816 00000100:00100000:2.0:1789578870.996556:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090816 00010000:00010000:2.0:1789578870.996565:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 25 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.996573:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277090944 00000100:00100000:2.0:1789578870.996575:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277090944 00010000:00010000:2.0:1789578870.996584:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 26 pid: 6485 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.996591:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091072 00000100:00100000:2.0:1789578870.996594:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091072 00010000:00010000:2.0:1789578870.996602:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 27 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578870.996613:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578870.996620:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+27:3617:x1876509277090688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789578870.996642:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578870.996648:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 27 pid: 6484 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996657:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 27 pid: 6484 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996678:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578870.996722:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+27:3617:x1876509277090688:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.996728:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578870.996743:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789578870.996749:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+26:3617:x1876509277090816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789578870.996762:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578870.996766:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 26 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996774:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 26 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996785:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578870.996787:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1789578870.996809:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+26:3617:x1876509277090816:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.996815:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789578870.996828:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789578870.996835:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3615:x1876509277090944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789578870.996841:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578870.996844:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 25 pid: 6485 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996857:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 25 pid: 6485 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996866:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578870.996899:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3615:x1876509277090944:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.996905:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789578870.996917:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789578870.996922:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277091072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789578870.996929:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578870.996933:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 24 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996941:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 24 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578870.996949:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578870.996967:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277091072:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578870.996972:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789578870.997032:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277090816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578870.997040:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277090688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789578870.997120:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277091072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789578870.997129:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277090944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789578870.997311:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578870.997344:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2fa00/0xd90373d592f20bc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20bbc expref: 23 pid: 6484 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.997385:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090176:0@lo:104: 00010000:00010000:3.0:1789578870.997398:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939400031e00/0xd90373d592f20a9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20a96 expref: 22 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.997423:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090304:0@lo:104: 00010000:00010000:3.0:1789578870.997436:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c6000/0xd90373d592f20a49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20a42 expref: 21 pid: 6485 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.997445:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090432:0@lo:104: 00010000:00010000:3.0:1789578870.997454:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687c00/0xd90373d592f20a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20a34 expref: 20 pid: 6482 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578870.997463:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090560:0@lo:104: 00000100:00100000:3.0:1789578871.003937:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578871.003982:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578871.004042:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306368 00000100:00100000:1.0:1789578871.004055:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306368 00000100:00100000:2.0:1789578871.004087:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306240 00000100:00100000:2.0:1789578871.004094:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306240 00000100:00100000:1.0:1789578871.004130:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 248 00010000:00010000:2.0:1789578871.004132:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 11 pid: 6485 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578871.004144:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:6165:x1876509261306368:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578871.004161:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578871.004183:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe03 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578871.004188:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789578871.004200:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:2395:x1876509261306240:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578871.004213:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578871.004218:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004220:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 12 pid: 6485 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578871.004246:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004630:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 12 pid: 6485 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004655:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004663:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004682:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004689:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004708:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004716:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004724:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789578871.004729:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004763:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 7/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004775:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004782:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.004817:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578871.004834:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6475:1876509277091200:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789578871.004965:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393023593c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789578871.005420:0:10370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401687400/0xd90373d592f20cdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdbd expref: 12 pid: 6485 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578871.005450:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10370:1876509277090048:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578871.005502:0:10370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.005514:0:10370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.005521:0:10370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 6/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578871.005894:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578871.005907:0:6482:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:1.0:1789578871.005923:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578871.005932:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e600, rc 0) 00000100:00100000:1.0:1789578871.006007:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:6165:x1876509261306368:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 1866us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578871.006016:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 248 00000100:00100000:0.0:1789578871.010885:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578871.011015:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6475:1876509277091200:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789578871.011066:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.011083:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a37a00/0xd90373d592f20d9f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.011100:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578871.011172:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261306240:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 6973us (7246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.011182:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789578871.011537:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306496 00000100:00100000:1.0:1789578871.011547:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306496 00000100:00100000:1.0:1789578871.011607:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 249 00000100:00100000:1.0:1789578871.011617:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306496:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578871.011769:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306496:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 153us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578871.011776:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 249 00000100:00100000:3.0:1789578871.019514:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578871.019662:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306624 00000100:00100000:0.0:1789578871.019677:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306624 00000100:00100000:0.0:1789578871.019765:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00100000:0.0:1789578871.019778:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306624:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.019972:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6165:x1876509261306624:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 197us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578871.019980:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00100000:0.0:1789578871.032634:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578871.034741:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306752 00000100:00100000:2.0:1789578871.034761:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306752 00000100:00100000:2.0:1789578871.034840:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 251 00000100:00100000:2.0:1789578871.034859:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6657:x1876509261306752:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789578871.035046:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6657:x1876509261306752:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 189us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.035054:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 251 00000100:00100000:3.0:1789578871.044844:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578871.044909:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261306880 00000100:00100000:1.0:1789578871.044928:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261306880 00000100:00100000:1.0:1789578871.044983:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 252 00000100:00100000:1.0:1789578871.044994:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6657:x1876509261306880:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789578871.045212:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:6657:x1876509261306880:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 218us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578871.045221:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 252 10000000:01000000:3.0:1789578871.780979:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789578871.780991:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939302b3c800 from 4 10000000:01000000:3.0:1789578871.780997:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789578871.781057:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.781070:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.781082:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578871.781109:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.781176:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.781592:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578871.782552:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091328 00000100:00100000:0.0:1789578871.782562:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091328 00000100:00100000:0.0:1789578871.782732:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789578871.782742:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277091328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578871.782759:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578871.782776:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20dad expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.782817:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20dad expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.782828:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dad expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.782842:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436c00, rc 0) 00000100:00100000:0.0:1789578871.782910:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578871.782917:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789578871.783055:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578871.783077:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.783087:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578871.783550:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.783587:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.783765:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578871.784898:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091456 00000100:00100000:2.0:1789578871.784916:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091456 00000100:00100000:2.0:1789578871.784983:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789578871.784995:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578871.785209:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.785218:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789578871.785832:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.785895:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.785970:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.786022:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578871.789003:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091584 00000100:00100000:2.0:1789578871.789026:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091584 00000100:00100000:2.0:1789578871.789117:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789578871.789129:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578871.789451:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.789461:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789578871.789557:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.790231:0:10394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10394:1876509277091712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.790305:0:10394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.790377:0:10394:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78000 going to sleep for 11 seconds 00000100:00100000:0.0:1789578871.790825:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091712 00000100:00100000:0.0:1789578871.790833:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091712 00000100:00100000:0.0:1789578871.790888:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789578871.790897:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10394:x1876509277091712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578871.791049:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10394:x1876509277091712:12345-0@lo:502:llog_process_th.0 Request processed in 152us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578871.791056:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789578871.791141:0:10394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10394:1876509277091712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789578871.791264:0:10394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789578871.791278:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578871.791281:0:10394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789578871.791288:0:10394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939302b3c800 00000020:00000080:2.0:1789578871.791291:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789578871.791422:0:10394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10394:1876509277091840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578871.791500:0:10394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578871.791551:0:10394:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.792333:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091840 00000100:00100000:3.0:1789578871.792343:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091840 00000100:00100000:3.0:1789578871.792456:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789578871.792467:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10394:x1876509277091840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.792624:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:10394:x1876509277091840:12345-0@lo:502:llog_process_th.0 Request processed in 159us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.792632:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789578871.792797:0:10394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10394:1876509277091840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789578871.792836:0:10394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789578871.792847:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789578871.792849:0:10394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789578871.792854:0:10394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789578871.793651:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789578871.793708:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789578871.793725:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.793740:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578871.793755:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789578871.793758:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943711c800 from 4 10000000:01000000:3.0:1789578871.793762:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789578871.793808:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.793816:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.793827:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578871.793853:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.793929:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.793979:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578871.794295:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277091968 00000100:00100000:2.0:1789578871.794303:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277091968 00000100:00100000:2.0:1789578871.794392:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789578871.794405:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277091968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578871.794421:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578871.794438:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20dbb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.794471:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20dbb expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.794483:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dbb expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.794493:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:2.0:1789578871.794550:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277091968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.794558:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789578871.796085:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277091968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578871.796119:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.796132:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578871.797860:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.797961:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.798016:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578871.798419:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092096 00000100:00100000:2.0:1789578871.798429:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092096 00000100:00100000:2.0:1789578871.798492:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789578871.798502:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277092096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578871.798663:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277092096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.798683:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789578871.799044:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.799098:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.799147:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.799183:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578871.799240:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092224 00000100:00100000:2.0:1789578871.799246:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092224 00000100:00100000:2.0:1789578871.799286:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789578871.799296:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277092224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578871.799480:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277092224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578871.799488:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789578871.804288:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.806912:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10397:1876509277092352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.807068:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.807132:0:10397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394069880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578871.807245:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092352 00000100:00100000:0.0:1789578871.807254:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092352 00000100:00100000:0.0:1789578871.808154:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789578871.808167:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10397:x1876509277092352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578871.808480:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10397:x1876509277092352:12345-0@lo:502:llog_process_th.0 Request processed in 315us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578871.808498:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789578871.808829:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10397:1876509277092352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.808876:0:10397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578871.808890:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.808892:0:10397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789578871.808902:0:10397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943711c800 00000020:00000080:3.0:1789578871.808906:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578871.809017:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10397:1876509277092480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.809091:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.809125:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092480 00000100:00100000:3.0:1789578871.809132:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092480 00000100:00100000:3.0:1789578871.809168:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789578871.809177:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10397:x1876509277092480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.809267:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:10397:x1876509277092480:12345-0@lo:502:llog_process_th.0 Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.809503:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789578871.809570:0:10397:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.809588:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10397:1876509277092480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.809610:0:10397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578871.809616:0:10397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.809618:0:10397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789578871.809623:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789578871.810773:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789578871.810814:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789578871.810828:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.810844:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578871.810857:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789578871.810861:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f42d800 from 4 10000000:01000000:0.0:1789578871.810865:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789578871.810910:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.810919:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.810931:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578871.810958:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.811181:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578871.811260:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.811901:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092608 00000100:00100000:3.0:1789578871.811912:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092608 00000100:00100000:3.0:1789578871.811982:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789578871.811995:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277092608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578871.812015:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578871.812141:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20dc9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.812176:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.812191:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.812201:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36600, rc 0) 00000100:00100000:3.0:1789578871.812820:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277092608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 824us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.812829:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789578871.812918:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578871.812941:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.812953:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578871.813139:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.813188:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578871.813232:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.813415:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092736 00000100:00100000:3.0:1789578871.813423:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092736 00000100:00100000:3.0:1789578871.813461:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789578871.813483:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277092736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.813748:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277092736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.813764:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789578871.813861:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.813903:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.813949:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578871.813984:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.814059:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092864 00000100:00100000:3.0:1789578871.814065:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092864 00000100:00100000:3.0:1789578871.814104:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789578871.814396:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277092864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.814501:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277092864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.814509:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789578871.814805:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277092864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.815344:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10399:1876509277092992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.815513:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578871.815548:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277092992 00000100:00100000:3.0:1789578871.815555:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578871.815556:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277092992 00000100:00100000:0.0:1789578871.815704:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789578871.815715:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10399:x1876509277092992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578871.815844:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10399:x1876509277092992:12345-0@lo:502:llog_process_th.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578871.815851:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789578871.816082:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10399:1876509277092992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.816116:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578871.816127:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.816130:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789578871.816139:0:10399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940f42d800 00000020:00000080:3.0:1789578871.816142:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578871.816221:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10399:1876509277093120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.816259:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.816284:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093120 00000100:00100000:3.0:1789578871.816289:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093120 00000100:00100000:3.0:1789578871.816315:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789578871.816322:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10399:x1876509277093120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.816420:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:10399:x1876509277093120:12345-0@lo:502:llog_process_th.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.816434:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789578871.816467:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.816479:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10399:1876509277093120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.816501:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578871.816506:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.816508:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789578871.816512:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789578871.817030:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789578871.817063:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789578871.817075:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.817089:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578871.817102:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789578871.817105:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940679b000 from 4 10000000:01000000:0.0:1789578871.817108:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789578871.817141:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.817156:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.817168:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578871.817187:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.817227:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578871.817296:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.819957:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093248 00000100:00100000:3.0:1789578871.819976:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093248 00000100:00100000:3.0:1789578871.820039:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789578871.820052:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277093248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578871.820073:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578871.820097:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20dd7 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.820132:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.820145:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.820154:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789578871.820247:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277093248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.820254:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789578871.820340:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578871.820382:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578871.820403:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578871.820503:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.820541:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.820577:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.820599:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093376 00000100:00100000:3.0:1789578871.820603:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093376 00000100:00100000:3.0:1789578871.820632:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789578871.820994:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277093376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.821145:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277093376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 505us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.821152:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789578871.821234:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.821276:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578871.821321:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.821442:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093504 00000100:00100000:3.0:1789578871.821448:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093504 00000100:00100000:3.0:1789578871.821481:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789578871.821490:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277093504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.821575:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277093504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.821583:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789578871.821734:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74780 going to sleep for 11 seconds 00000100:00100000:0.0:1789578871.821750:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277093504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578871.824471:0:10400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10400:1876509277093632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.824863:0:10400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.824924:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093632 00000100:00100000:3.0:1789578871.824932:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093632 00000100:00100000:3.0:1789578871.824990:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789578871.825010:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:10400:x1876509277093632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.825168:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:10400:x1876509277093632:12345-0@lo:502:llog_process_th.0 Request processed in 160us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.825177:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789578871.825244:0:10400:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410cab900 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.825285:0:10400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10400:1876509277093632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.825322:0:10400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578871.825334:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.825337:0:10400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789578871.825347:0:10400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940679b000 00000020:00000080:3.0:1789578871.825375:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578871.825465:0:10400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10400:1876509277093760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.825510:0:10400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578871.825988:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093760 00000100:00100000:3.0:1789578871.825994:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093760 00000100:00100000:3.0:1789578871.826029:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789578871.826037:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:10400:x1876509277093760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578871.826189:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:10400:x1876509277093760:12345-0@lo:502:llog_process_th.0 Request processed in 152us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578871.826197:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789578871.826246:0:10400:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410cab900 going to sleep for 11 seconds 00000100:00100000:3.0:1789578871.826265:0:10400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:10400:1876509277093760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578871.827280:0:10400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578871.827295:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578871.827298:0:10400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789578871.827305:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789578871.829010:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789578871.829054:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578871.829070:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578871.829086:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578871.914906:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578872.941187:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578873.187629:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277093888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578873.187709:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.187758:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277094400:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.187786:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.187806:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277094912:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.187833:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.187854:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277095424:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.187877:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.187912:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789578873.187919:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578873.187945:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.187971:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277094528:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.187993:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188012:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095040:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188037:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188055:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095552:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188103:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277094272:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188124:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188141:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277094784:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188176:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188188:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277095296:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188207:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188219:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789578873.188225:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277094144:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188248:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188267:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277094656:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188287:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188305:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095168:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188324:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188341:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095680:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188381:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578873.188425:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277093888 00000100:00100000:0.0:1789578873.188434:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277093888 00000100:00100000:0.0:1789578873.188487:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094016 00000100:00100000:0.0:1789578873.188490:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094016 00000100:00100000:0.0:1789578873.188513:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789578873.188523:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277093888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578873.188552:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578873.188598:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277093888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.188605:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789578873.188623:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789578873.188629:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277094016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578873.188640:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578873.188664:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277094016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.188670:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789578873.188701:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094400 00000100:00100000:0.0:1789578873.188705:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094400 00000100:00100000:0.0:1789578873.188727:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094656 00000100:00100000:0.0:1789578873.188730:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094656 00000100:00100000:0.0:1789578873.188747:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789578873.188754:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277094400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188794:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277094400:12345-0@lo:400:kworker.0 Request processed in 41us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.188801:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789578873.188813:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789578873.188820:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277094656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.188868:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277094656:12345-0@lo:400:kworker.0 Request processed in 49us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.188874:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789578873.188895:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094912 00000100:00100000:0.0:1789578873.188899:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094912 00000100:00100000:0.0:1789578873.188924:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095424 00000100:00100000:0.0:1789578873.188927:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095424 00000100:00100000:0.0:1789578873.188940:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094528 00000100:00100000:0.0:1789578873.188943:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094528 00000100:00100000:0.0:1789578873.188955:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094272 00000100:00100000:0.0:1789578873.188958:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094272 00000100:00100000:0.0:1789578873.188972:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094784 00000100:00100000:0.0:1789578873.188974:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094784 00000100:00100000:0.0:1789578873.188988:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095296 00000100:00100000:0.0:1789578873.188991:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095296 00000100:00100000:0.0:1789578873.189007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789578873.189013:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277094912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189047:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277094912:12345-0@lo:400:kworker.0 Request processed in 34us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189053:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789578873.189066:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789578873.189073:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189100:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277095424:12345-0@lo:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189105:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789578873.189116:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789578873.189122:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277094528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189144:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277094528:12345-0@lo:400:kworker.0 Request processed in 23us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189156:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789578873.189167:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789578873.189172:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277094272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189194:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277094272:12345-0@lo:400:kworker.0 Request processed in 23us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189199:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789578873.189209:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789578873.189215:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277094784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189239:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277094784:12345-0@lo:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189245:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789578873.189256:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789578873.189261:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189285:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277095296:12345-0@lo:400:kworker.0 Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189290:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789578873.189325:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095040 00000100:00100000:0.0:1789578873.189330:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095040 00000100:00100000:0.0:1789578873.189384:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095552 00000100:00100000:0.0:1789578873.189387:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095552 00000100:00100000:0.0:1789578873.189400:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095168 00000100:00100000:0.0:1789578873.189402:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095168 00000100:00100000:0.0:1789578873.189410:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095680 00000100:00100000:0.0:1789578873.189412:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095680 00000100:00100000:0.0:1789578873.189421:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789578873.189425:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189464:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095040:12345-0@lo:400:kworker.0 Request processed in 38us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189470:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789578873.189482:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789578873.189488:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189512:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095552:12345-0@lo:400:kworker.0 Request processed in 25us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189517:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789578873.189528:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578873.189534:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189554:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095168:12345-0@lo:400:kworker.0 Request processed in 21us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189559:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789578873.189567:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578873.189573:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189608:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095680:12345-0@lo:400:kworker.0 Request processed in 35us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189614:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789578873.189657:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277094656:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.189671:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4f480 x1876509277095168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.189697:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095168:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.189709:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5c00 x1876509277095680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.189730:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095680:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189748:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277094272:0@lo:400:kworker.0 00000100:00100000:3.0:1789578873.189753:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277094144 00000100:00100000:3.0:1789578873.189759:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277094144 00000100:00100000:0.0:1789578873.189760:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277094784:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189775:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277095296:0@lo:400:kworker.0 00000100:00100000:3.0:1789578873.189799:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789578873.189809:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578873.189811:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277094144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.189845:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578873.189871:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277094144:12345-0@lo:400:kworker.0 Request processed in 63us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.189880:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277094144:0@lo:400:kworker.0 00000100:00100000:3.0:1789578873.189881:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789578873.189908:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095808 00000100:00100000:0.0:1789578873.189912:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095808 00000100:00080000:3.0:1789578873.189918:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578873.189925:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578873.189927:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578873.189930:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578873.189940:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789578873.189948:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789578873.189965:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578873.190008:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277095808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578873.190014:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789578873.190042:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4a300 x1876509277094016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190057:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578873.190068:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277094528:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.190077:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4c700 x1876509277095040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190098:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095040:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.190109:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e4380 x1876509277095552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190117:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095552:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.190138:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a49f80 x1876509277093888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789578873.190139:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b30e00 x1876509277095808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190169:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277093888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578873.190172:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277095808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578873.190186:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277094400:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.190200:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437357100 x1876509277094912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190209:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277094912:0@lo:400:kworker.0 00010000:00080000:0.0:1789578873.190219:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5880 x1876509277095424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.190225:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277095424:0@lo:400:kworker.0 00000100:00100000:0.0:1789578873.193879:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578873.193960:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578873.194143:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277095936 00000100:00100000:1.0:1789578873.194159:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277095936 00000100:00100000:1.0:1789578873.194229:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789578873.194240:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789578873.194265:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578873.194331:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277095936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578873.194338:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789578873.194445:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b30e00 x1876509277095936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578873.194466:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277095936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789578873.956816:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578874.215881:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277096064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578874.215990:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578874.216090:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096064 00000100:00100000:1.0:1789578874.216100:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096064 00000100:00100000:1.0:1789578874.216156:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789578874.216166:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277096064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578874.216208:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578874.216260:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277096064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578874.216267:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789578874.216320:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277096064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578874.217098:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277096192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578874.217144:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578874.217243:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096192 00000100:00100000:3.0:1789578874.217249:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096192 00000100:00100000:3.0:1789578874.217287:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789578874.217295:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277096192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578874.217320:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578874.217391:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277096192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578874.217397:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578874.220882:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277096192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789578874.983954:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578874.998774:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578874.998828:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578874.998863:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578874.998883:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578874.998934:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578874.998981:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307392 00000100:00100000:3.0:1789578874.998994:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307392 00000100:00100000:3.0:1789578874.999068:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307520 00000100:00100000:3.0:1789578874.999072:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307520 00000100:00100000:3.0:1789578874.999101:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789578874.999112:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307392:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578874.999611:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307136 00000100:00100000:2.0:1789578874.999624:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307136 00000100:00100000:2.0:1789578874.999698:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307264 00000100:00100000:2.0:1789578874.999701:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307264 00000100:00100000:2.0:1789578874.999732:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789578874.999863:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261307136:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578874.999944:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261307136:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 203us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578874.999965:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789578874.999986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789578874.999992:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307264:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578875.000019:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307264:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578875.000025:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00080000:2.0:1789578875.000074:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578875.000078:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578875.000081:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578875.000083:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578875.000097:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789578875.000106:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307520:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578875.000131:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307520:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578875.000137:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:2.0:1789578875.000163:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307008 00000100:00100000:2.0:1789578875.000168:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307008 00000100:00100000:2.0:1789578875.000196:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 274 00000100:00100000:2.0:1789578875.000203:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261307008:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578875.000228:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261307008:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578875.000233:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 274 00000100:00100000:3.0:1789578875.000769:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261307392:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 1649us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578875.000783:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00010000:00010000:3.0:1789578876.004460:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578877.027462:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789578877.523312:0:10670:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789578878.051501:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578878.311969:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578878.312323:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.312623:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578878.312669:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.312708:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096320 00000100:00100000:1.0:1789578878.312716:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096320 00000100:00100000:1.0:1789578878.312765:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096448 00000100:00100000:1.0:1789578878.312767:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096448 00000100:00100000:1.0:1789578878.312785:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789578878.312794:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277096320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789578878.312823:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578878.312867:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277096320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.312875:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789578878.312903:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789578878.312909:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789578878.312919:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578878.312948:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.312954:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789578878.312987:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350e680 x1876509277096448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.313006:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277096448:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789578878.313636:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e4380 x1876509277096320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578878.313662:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578878.314318:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277096576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578878.314397:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789578878.315742:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789578878.316816:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277096704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578878.316879:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.316916:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277097216:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.316942:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578878.316956:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096576 00000100:00100000:2.0:1789578878.316966:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096576 00000100:00100000:1.0:1789578878.316967:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277097728:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.316994:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.317022:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789578878.317024:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096704 00000100:00100000:2.0:1789578878.317029:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096704 00000100:00100000:1.0:1789578878.317030:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277096832:0@lo:400:kworker.0 00000100:00100000:2.0:1789578878.317057:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578878.317065:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578878.317070:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277096576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578878.317100:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578878.317145:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277096576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578878.317152:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789578878.317180:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789578878.317187:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277096704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578878.317197:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578878.317222:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277096704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578878.317228:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789578878.317244:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789578878.317436:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277097344:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.317466:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.318076:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277097856:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.318116:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789578878.318189:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5f800 x1876509277096704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.318210:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277096704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578878.318239:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097216 00000100:00100000:1.0:1789578878.318244:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097216 00000100:00100000:1.0:1789578878.318278:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097856 00000100:00100000:1.0:1789578878.318281:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097856 00000100:00100000:1.0:1789578878.318306:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578878.318313:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277097216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.318383:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277097216:12345-0@lo:400:kworker.0 Request processed in 70us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.318390:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578878.318406:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578878.318413:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.318439:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277097856:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.318445:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578878.318463:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097728 00000100:00100000:1.0:1789578878.318467:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097728 00000100:00100000:2.0:1789578878.318570:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097344 00000100:00100000:2.0:1789578878.318576:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097344 00000100:00100000:2.0:1789578878.318616:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789578878.318626:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277097344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578878.318629:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096832 00000100:00100000:3.0:1789578878.318635:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096832 00000100:00100000:2.0:1789578878.318682:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277097344:12345-0@lo:400:kworker.0 Request processed in 58us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578878.318690:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789578878.318734:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789578878.318744:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277096832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578878.318780:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277096832:12345-0@lo:400:kworker.0 Request processed in 39us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578878.318786:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789578878.320604:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789578878.320619:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277097728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320697:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277097728:12345-0@lo:400:kworker.0 Request processed in 82us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.320704:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789578878.320734:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578878.320751:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277096960:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320795:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.320820:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277097472:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320841:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.320858:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277097984:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320883:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.320905:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789578878.320911:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277097088:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320933:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.320951:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277097600:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.320969:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578878.320992:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277096960 00000100:00100000:1.0:1789578878.320998:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277096960 00000100:00100000:1.0:1789578878.321018:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097472 00000100:00100000:1.0:1789578878.321020:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097472 00000100:00100000:1.0:1789578878.321040:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097984 00000100:00100000:1.0:1789578878.321042:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097984 00000100:00100000:1.0:1789578878.321053:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097600 00000100:00100000:1.0:1789578878.321055:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097600 00000100:00100000:1.0:1789578878.321069:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578878.321075:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277096960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321108:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277096960:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.321114:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578878.321125:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789578878.321132:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277097472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321158:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277097472:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.321173:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789578878.321188:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789578878.321193:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277097984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321225:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277097984:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.321230:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789578878.321241:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789578878.321248:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277097600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321273:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277097600:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.321278:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789578878.321295:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277097088 00000100:00100000:1.0:1789578878.321299:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277097088 00000100:00100000:1.0:1789578878.321321:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578878.321327:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321376:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277097088:12345-0@lo:400:kworker.0 Request processed in 49us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578878.321382:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789578878.321397:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578878.321400:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578878.321425:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277097088:0@lo:400:kworker.0 00010000:00080000:1.0:1789578878.321438:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5ed80 x1876509277097600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.321448:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277097600:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.321458:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277096960:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.323627:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277097472:0@lo:400:kworker.0 00010000:00080000:1.0:1789578878.323669:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a81f80 x1876509277097984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.323680:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277097984:0@lo:400:kworker.0 00010000:00080000:1.0:1789578878.323732:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b32300 x1876509277096576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.323749:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277096576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578878.323782:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277096832:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.323793:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277097344:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.323803:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277097856:0@lo:400:kworker.0 00000100:00100000:1.0:1789578878.323813:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277097216:0@lo:400:kworker.0 00010000:00080000:1.0:1789578878.323824:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5c700 x1876509277097728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578878.323833:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277097728:0@lo:400:kworker.0 00010000:00010000:3.0:1789578879.076071:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578879.332572:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277098240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578879.332664:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578879.332861:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098240 00000100:00100000:3.0:1789578879.332869:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098240 00000100:00100000:3.0:1789578879.332922:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789578879.332932:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277098240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578879.332965:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578879.333020:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277098240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578879.333027:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789578879.333087:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277098240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578879.333533:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277098112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578879.333569:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578879.333723:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098112 00000100:00100000:3.0:1789578879.333728:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098112 00000100:00100000:3.0:1789578879.333765:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789578879.333774:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277098112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578879.333794:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578879.333844:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277098112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578879.333855:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789578879.333890:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277098112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789578880.099760:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578880.124619:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578880.124695:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578880.124737:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578880.124761:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578880.124789:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578880.124828:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307648 00000100:00100000:2.0:1789578880.124841:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307648 00000100:00100000:2.0:1789578880.124909:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 276 00000100:00100000:2.0:1789578880.124922:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261307648:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578880.125017:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2395:x1876509261307648:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578880.125025:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 276 00000100:00100000:2.0:1789578880.125068:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307776 00000100:00100000:2.0:1789578880.125073:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307776 00000100:00100000:2.0:1789578880.125126:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261307904 00000100:00100000:2.0:1789578880.125130:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261307904 00000100:00100000:2.0:1789578880.125156:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:2.0:1789578880.125162:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261307776:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578880.125264:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:3.0:1789578880.125275:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261307904:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578880.125314:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261307904:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 42us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578880.125321:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789578880.125515:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308032 00000100:00100000:0.0:1789578880.125520:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308032 00000100:00100000:0.0:1789578880.125564:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308160 00000100:00100000:0.0:1789578880.125567:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308160 00000100:00100000:0.0:1789578880.125593:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:0.0:1789578880.125602:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261308032:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578880.125643:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261308032:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 43us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578880.125649:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:0.0:1789578880.125662:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:0.0:1789578880.125668:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261308160:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578880.125694:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261308160:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578880.125700:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00080000:3.0:1789578880.126429:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578880.126436:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578880.126439:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578880.126441:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578880.127664:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261307776:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 2493us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578880.127675:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00010000:00010000:2.0:1789578881.123655:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578882.147876:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578883.172650:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789578883.289986:0:10913:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing yml_node 00000100:00100000:1.0:1789578883.432504:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578883.432572:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.432649:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578883.432671:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.432716:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098368 00000100:00100000:1.0:1789578883.432727:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098368 00000100:00100000:1.0:1789578883.432770:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098496 00000100:00100000:1.0:1789578883.432773:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098496 00000100:00100000:1.0:1789578883.432787:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578883.432795:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277098368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578883.432830:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578883.432869:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277098368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.432876:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578883.432893:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789578883.432898:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277098496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789578883.432915:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578883.432940:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277098496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.432946:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789578883.432984:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5fb80 x1876509277098496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578883.433003:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277098496:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789578883.433030:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5df80 x1876509277098368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578883.433040:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578883.434868:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277098624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578883.434925:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789578883.434968:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578883.434973:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578883.435329:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098624 00000100:00100000:2.0:1789578883.435337:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098624 00000100:00100000:2.0:1789578883.435417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789578883.435569:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277098624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578883.435601:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578883.435797:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277098624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 372us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578883.436325:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277098880:0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.436381:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578883.438253:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277099392:0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.438315:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578883.438366:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277099904:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.438523:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277098752:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.438557:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578883.438581:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277099264:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.438758:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578883.438779:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277099776:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.438800:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578883.438835:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098880 00000100:00100000:3.0:1789578883.438842:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098880 00000100:00100000:3.0:1789578883.438879:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099392 00000100:00100000:3.0:1789578883.438883:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099392 00000100:00100000:3.0:1789578883.438897:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099776 00000100:00100000:3.0:1789578883.438899:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099776 00000100:00100000:3.0:1789578883.438912:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789578883.438919:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.438963:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277098880:12345-0@lo:400:kworker.0 Request processed in 43us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578883.438969:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789578883.438984:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578883.438990:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.439015:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277099392:12345-0@lo:400:kworker.0 Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578883.439021:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578883.439031:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578883.439037:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277099776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.439065:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277099776:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578883.439071:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578883.439087:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277098752 00000100:00100000:3.0:1789578883.439090:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277098752 00000100:00100000:3.0:1789578883.439114:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789578883.439125:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277098752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439332:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277099008:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439402:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439424:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277099520:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439455:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439473:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277100032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578883.439494:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439511:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789578883.439516:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277099136:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439533:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439542:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277099648:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439554:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439571:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099264 00000100:00100000:1.0:1789578883.439575:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099264 00000100:00100000:0.0:1789578883.439583:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578883.439596:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099008 00000100:00100000:1.0:1789578883.439598:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099008 00000100:00100000:1.0:1789578883.439624:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789578883.439630:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439662:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277099264:12345-0@lo:400:kworker.0 Request processed in 32us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.439668:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789578883.439681:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789578883.439686:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277099008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439715:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277099008:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.439721:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789578883.439736:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100032 00000100:00100000:1.0:1789578883.439740:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100032 00000100:00100000:1.0:1789578883.439764:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789578883.439769:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277100032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578883.439778:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00002000:00000024:1.0:1789578883.439793:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578883.439815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099520 00000100:00100000:2.0:1789578883.439818:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099520 00000100:00100000:1.0:1789578883.439824:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277100032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.439830:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578883.439836:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099136 00000100:00100000:2.0:1789578883.439837:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099136 00000100:00100000:2.0:1789578883.439847:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099648 00000100:00100000:2.0:1789578883.439849:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099648 00000100:00100000:2.0:1789578883.439861:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789578883.439866:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439867:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277099008:0@lo:400:kworker.0 00010000:00080000:1.0:1789578883.439880:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4b480 x1876509277100032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578883.439895:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277100032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578883.439896:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277099520:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578883.439901:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789578883.439911:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1789578883.439915:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a49500 x1876509277099520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578883.439916:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277099136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439924:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277099520:0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.439964:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277098880:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439970:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789578883.439975:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277099392:0@lo:400:kworker.0 00000100:00100000:1.0:1789578883.439977:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277099648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.439996:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277099904 00000100:00100000:0.0:1789578883.439999:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277099904 00000100:00100000:3.0:1789578883.440073:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277098752:12345-0@lo:400:kworker.0 Request processed in 947us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578883.440080:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789578883.440112:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277098752:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.440122:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277099264:0@lo:400:kworker.0 00010000:00080000:3.0:1789578883.440142:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4b100 x1876509277099776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578883.440151:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277099776:0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.440220:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789578883.440228:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277099904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578883.440263:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277099904:12345-0@lo:400:kworker.0 Request processed in 37us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578883.440269:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789578883.440294:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4aa00 x1876509277099904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578883.440303:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277099904:0@lo:400:kworker.0 00010000:00080000:3.0:1789578883.446830:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b33480 x1876509277098624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578883.446858:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277098624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578883.447281:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277099136:12345-0@lo:400:kworker.0 Request processed in 7360us (7742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578883.447292:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789578883.447340:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578883.447346:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578883.448291:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578883.448297:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789578883.453818:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277099648:12345-0@lo:400:kworker.0 Request processed in 13832us (14252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578883.453833:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789578883.455314:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277099136:0@lo:400:kworker.0 00000100:00100000:3.0:1789578883.455336:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277099648:0@lo:400:kworker.0 00010000:00010000:3.0:1789578884.202633:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578884.451640:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277100160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578884.451716:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578884.451882:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789578884.451894:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277100288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578884.451923:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578884.451957:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100160 00000100:00100000:1.0:1789578884.451964:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100160 00000100:00100000:1.0:1789578884.452001:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100288 00000100:00100000:1.0:1789578884.452003:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100288 00000100:00100000:1.0:1789578884.452019:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789578884.452027:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277100160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578884.452075:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789578884.452121:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277100160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578884.452129:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789578884.452146:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789578884.452152:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277100288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578884.452167:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578884.452196:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277100288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578884.452202:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789578884.452237:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277100288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578884.452265:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277100160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789578885.219566:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578885.249983:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578885.250021:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578885.250444:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578885.251262:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308288 00000100:00100000:3.0:1789578885.251274:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308288 00000100:00100000:3.0:1789578885.251330:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 278 00000100:00100000:3.0:1789578885.251341:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261308288:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578885.251446:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261308288:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 107us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578885.251453:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 278 00000100:00100000:1.0:1789578885.255415:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308416 00000100:00100000:1.0:1789578885.255431:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308416 00000100:00100000:1.0:1789578885.255514:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308544 00000100:00100000:1.0:1789578885.255518:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308544 00000100:00100000:1.0:1789578885.255551:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789578885.255560:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261308416:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578885.255649:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261308416:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 90us (5627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578885.255657:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789578885.255672:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789578885.255678:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261308544:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578885.255700:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261308544:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (5257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578885.255717:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00080000:2.0:1789578885.255797:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578885.255801:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578885.259667:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578885.259706:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578885.259775:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308672 00000100:00100000:3.0:1789578885.259784:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308672 00000100:00100000:3.0:1789578885.259850:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308800 00000100:00100000:3.0:1789578885.259853:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308800 00000100:00100000:3.0:1789578885.259874:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789578885.259883:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261308672:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:3.0:1789578885.259922:0:10029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20cf0 00000100:00080000:3.0:1789578885.259931:0:10029:0:(import.c:65:import_set_state_nolock()) ffff93930206e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789578885.259973:0:10029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789578885.260138:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+2:2391:x1876509261308672:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 255us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578885.260146:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789578885.260161:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789578885.260167:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261308800:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:3.0:1789578885.260180:0:10029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20cf7 00000100:00080000:3.0:1789578885.260186:0:10029:0:(import.c:65:import_set_state_nolock()) ffff93930206f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789578885.260216:0:10029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789578885.260300:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+2:2391:x1876509261308800:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 132us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578885.260306:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00010000:00010000:2.0:1789578885.260781:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789578885.260789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578885.260793:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789578885.261261:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578886.244048:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578887.270334:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789578887.716395:0:11097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789578888.292153:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578888.547502:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277100416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578888.547588:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578888.547888:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277100544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578888.547918:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578888.547955:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100416 00000100:00100000:3.0:1789578888.547962:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100416 00000100:00100000:3.0:1789578888.548006:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100544 00000100:00100000:3.0:1789578888.548009:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100544 00000100:00100000:3.0:1789578888.548025:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578888.548041:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277100416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789578888.548068:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578888.548111:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277100416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578888.548118:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789578888.548134:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789578888.548140:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277100544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789578888.548154:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578888.548183:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277100544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578888.548189:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789578888.548204:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578888.548208:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789578888.548234:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b31500 x1876509277100544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578888.548251:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277100544:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789578888.548278:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4aa00 x1876509277100416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578888.548289:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277100416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578888.548533:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277100800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578888.548563:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578888.548640:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100800 00000100:00100000:2.0:1789578888.548645:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100800 00000100:00100000:2.0:1789578888.548680:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789578888.548906:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578888.548937:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277100800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578888.548951:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578888.548993:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277100800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578888.548999:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789578888.549061:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bfb80 x1876509277100800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578888.549073:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277100800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578888.549217:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277100672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578888.549244:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578888.549332:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100672 00000100:00100000:2.0:1789578888.549337:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100672 00000100:00100000:2.0:1789578888.549396:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789578888.549402:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277100672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578888.549413:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578888.549442:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277100672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578888.549448:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789578888.549497:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789578888.549621:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a49880 x1876509277100672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578888.549634:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277100672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578888.553209:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277100928:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.553281:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578888.553378:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277100928 00000100:00100000:1.0:1789578888.553385:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277100928 00000100:00100000:1.0:1789578888.553434:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789578888.553443:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277100928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.554886:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277100928:12345-0@lo:400:kworker.0 Request processed in 1438us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.554900:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789578888.554997:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277100928:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555016:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578888.555027:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277101312:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555071:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578888.555119:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277101056:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555142:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578888.555171:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578888.555177:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277101184:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555203:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578888.555233:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101184 00000100:00100000:3.0:1789578888.555239:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101184 00000100:00100000:3.0:1789578888.555277:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578888.555285:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277101184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555328:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277101184:12345-0@lo:400:kworker.0 Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578888.555335:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578888.555392:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277101184:0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.555450:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101312 00000100:00100000:1.0:1789578888.555453:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101312 00000100:00100000:1.0:1789578888.555483:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101056 00000100:00100000:1.0:1789578888.555485:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101056 00000100:00100000:1.0:1789578888.555502:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789578888.555508:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277101312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.555541:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277101312:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.555555:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789578888.555580:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789578888.555586:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277101056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.555615:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277101056:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.555621:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789578888.555793:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277101056:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555816:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277101312:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555944:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277101440:0@lo:400:kworker.0 00000100:00100000:3.0:1789578888.555972:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578888.556079:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101440 00000100:00100000:0.0:1789578888.556084:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101440 00000100:00100000:0.0:1789578888.556109:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789578888.556115:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277101440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556167:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277101568:0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556191:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578888.556209:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578888.556214:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277101696:0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556232:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578888.556252:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101568 00000100:00100000:1.0:1789578888.556256:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101568 00000100:00100000:1.0:1789578888.556280:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101696 00000100:00100000:1.0:1789578888.556283:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101696 00000100:00100000:1.0:1789578888.556300:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789578888.556305:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277101568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556336:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277101568:12345-0@lo:400:kworker.0 Request processed in 30us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.556342:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789578888.556372:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789578888.556378:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277101696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556404:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277101696:12345-0@lo:400:kworker.0 Request processed in 27us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.556410:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789578888.556432:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578888.556436:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789578888.556457:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bd500 x1876509277101696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578888.556468:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277101696:0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556477:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277101568:0@lo:400:kworker.0 00000100:00100000:2.0:1789578888.556595:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277101824:0@lo:400:kworker.0 00000100:00100000:2.0:1789578888.556623:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578888.556683:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578888.556689:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277101952:0@lo:400:kworker.0 00000100:00100000:2.0:1789578888.556711:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578888.556758:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277101440:12345-0@lo:400:kworker.0 Request processed in 642us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578888.556770:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578888.556890:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277101440:0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.556972:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101824 00000100:00100000:1.0:1789578888.556976:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101824 00000100:00100000:1.0:1789578888.557001:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277101952 00000100:00100000:1.0:1789578888.557003:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277101952 00000100:00100000:1.0:1789578888.557015:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789578888.557020:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277101824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.557054:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277101824:12345-0@lo:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.557060:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789578888.557071:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789578888.557076:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277101952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578888.557099:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277101952:12345-0@lo:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578888.557104:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789578888.557117:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578888.557120:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789578888.557209:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362be300 x1876509277101952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578888.557219:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277101952:0@lo:400:kworker.0 00000100:00100000:2.0:1789578888.557227:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277101824:0@lo:400:kworker.0 00010000:00010000:2.0:1789578889.315622:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578889.571664:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578889.571688:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277102080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578889.571752:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578889.571874:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102080 00000100:00100000:1.0:1789578889.571881:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102080 00000100:00100000:1.0:1789578889.571926:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789578889.571935:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277102080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578889.571967:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578889.572028:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277102080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578889.572036:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789578889.572079:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277102080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578889.572208:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277102208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578889.572234:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578889.572301:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102208 00000100:00100000:3.0:1789578889.572306:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102208 00000100:00100000:3.0:1789578889.572336:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789578889.572343:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277102208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578889.572389:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578889.572424:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277102208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578889.572429:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789578889.572545:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277102208:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789578890.229909:0:11194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1789578890.342913:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578890.367662:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578890.367705:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578890.367727:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578890.369487:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309184 00000100:00100000:1.0:1789578890.369503:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309184 00000100:00100000:1.0:1789578890.369584:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309056 00000100:00100000:1.0:1789578890.369588:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309056 00000100:00100000:1.0:1789578890.369616:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:1.0:1789578890.369625:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261309184:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578890.369711:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261309184:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 86us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578890.369718:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:1.0:1789578890.369735:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:1.0:1789578890.369741:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261309056:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578890.369763:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261309056:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578890.369769:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00080000:1.0:1789578890.369916:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578890.369921:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578890.370280:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261308928 00000100:00100000:2.0:1789578890.370286:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261308928 00000100:00100000:2.0:1789578890.370320:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 280 00000100:00100000:2.0:1789578890.370399:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2392:x1876509261308928:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578890.370430:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2392:x1876509261308928:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 33us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578890.370436:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 280 00000001:00100000:1.0:1789578890.598833:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:1.0:1789578890.598845:0:9483:0:(genops.c:885:class_export_put()) final put ffff93930206a000/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:1.0:1789578890.598882:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206a000/28fc5077-c53d-437a-bade-84c159d25114 for lustre-OST0001 00000020:00000080:1.0:1789578890.599190:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930206f000 for lustre-OST0001 00000001:00100000:3.0:1789578890.609060:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:3.0:1789578890.609075:0:8398:0:(genops.c:885:class_export_put()) final put ffff93930206c000/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:0.0:1789578890.609257:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206c000/28fc5077-c53d-437a-bade-84c159d25114 for lustre-OST0000 00000020:00000080:0.0:1789578890.609325:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930206e800 for lustre-OST0000 00010000:00010000:2.0:1789578891.367997:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578892.389113:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789578893.220159:0:11292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789578893.412294:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578893.667875:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277102464:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.667941:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668257:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277102976:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668525:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668563:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277103488:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668611:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789578893.668618:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277102336:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668645:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668664:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277102848:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668685:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668712:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277103360:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668733:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668748:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277103872:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668765:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578893.668817:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102464 00000100:00100000:3.0:1789578893.668824:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102464 00000100:00100000:3.0:1789578893.668866:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102976 00000100:00100000:3.0:1789578893.668869:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102976 00000100:00100000:3.0:1789578893.668890:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103488 00000100:00100000:3.0:1789578893.668893:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103488 00000100:00100000:3.0:1789578893.668909:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789578893.668917:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.668963:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277102464:12345-0@lo:400:kworker.0 Request processed in 46us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669070:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578893.669079:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277104000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578893.669106:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578893.669132:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104000 00000100:00100000:2.0:1789578893.669135:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104000 00000100:00100000:2.0:1789578893.669160:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789578893.669167:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277104000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578893.669187:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578893.669219:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277104000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669226:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789578893.669263:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93942a0d1c00 x1876509277104000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578893.669294:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277104000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578893.669365:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103360 00000100:00100000:2.0:1789578893.669368:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103360 00000100:00100000:2.0:1789578893.669390:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103872 00000100:00100000:2.0:1789578893.669393:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103872 00000100:00100000:2.0:1789578893.669589:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789578893.669597:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669632:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277103360:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669638:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789578893.669649:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789578893.669655:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277103872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669681:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277103872:12345-0@lo:400:kworker.0 Request processed in 27us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669687:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789578893.669704:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102848 00000100:00100000:2.0:1789578893.669708:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102848 00000100:00100000:2.0:1789578893.669730:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789578893.669735:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277102848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669762:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277102848:12345-0@lo:400:kworker.0 Request processed in 27us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669767:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789578893.669782:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102336 00000100:00100000:2.0:1789578893.669785:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102336 00000100:00100000:2.0:1789578893.669805:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789578893.669811:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277102336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669843:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277102336:12345-0@lo:400:kworker.0 Request processed in 32us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669849:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789578893.669872:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789578893.669879:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277102976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669902:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277102976:12345-0@lo:400:kworker.0 Request processed in 24us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669908:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789578893.669919:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789578893.669924:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578893.669947:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277103488:12345-0@lo:400:kworker.0 Request processed in 23us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578893.669952:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789578893.670117:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789578893.670139:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578893.670143:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578893.670146:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578893.670164:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277102336:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.670175:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277102848:0@lo:400:kworker.0 00010000:00080000:3.0:1789578893.670185:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30700 x1876509277103360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578893.670194:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277103360:0@lo:400:kworker.0 00010000:00080000:3.0:1789578893.670202:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33800 x1876509277103872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578893.670210:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277103872:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.670229:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277102464:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.670239:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277102976:0@lo:400:kworker.0 00000100:00100000:3.0:1789578893.670249:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277103488:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673544:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277102592:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673618:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673653:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277103104:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673678:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673698:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277103616:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673717:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673733:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277104128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578893.673755:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673783:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789578893.673790:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277102720:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673809:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673823:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277103232:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673841:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673858:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277103744:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.673876:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.673945:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102592 00000100:00100000:1.0:1789578893.673952:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102592 00000100:00100000:1.0:1789578893.674004:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789578893.674012:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277102592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674068:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277102592:12345-0@lo:400:kworker.0 Request processed in 56us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.674075:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789578893.674109:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277104256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578893.674135:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578893.674175:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277102592:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674196:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103232 00000100:00100000:1.0:1789578893.674200:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103232 00000100:00100000:1.0:1789578893.674227:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103744 00000100:00100000:1.0:1789578893.674230:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103744 00000100:00100000:1.0:1789578893.674242:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578893.674248:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277103232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674291:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277103232:12345-0@lo:400:kworker.0 Request processed in 43us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.674297:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789578893.674308:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789578893.674314:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277103744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674372:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277103744:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.674378:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789578893.674400:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31c00 x1876509277103232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.674410:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277103232:0@lo:400:kworker.0 00010000:00080000:1.0:1789578893.674419:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33b80 x1876509277103744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.674427:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277103744:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674449:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103104 00000100:00100000:1.0:1789578893.674453:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103104 00000100:00100000:1.0:1789578893.674830:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277103616 00000100:00100000:1.0:1789578893.674834:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277103616 00000100:00100000:1.0:1789578893.674846:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277102720 00000100:00100000:1.0:1789578893.674848:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277102720 00000100:00100000:1.0:1789578893.674859:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789578893.674866:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277103104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674909:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277103104:12345-0@lo:400:kworker.0 Request processed in 44us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.674914:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789578893.674926:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789578893.674932:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277103616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.674957:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277103616:12345-0@lo:400:kworker.0 Request processed in 26us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.674962:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789578893.674972:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789578893.674977:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277102720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.675000:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277102720:12345-0@lo:400:kworker.0 Request processed in 23us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.675005:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789578893.675032:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277102720:0@lo:400:kworker.0 00010000:00080000:1.0:1789578893.675044:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30380 x1876509277103104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.675052:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277103104:0@lo:400:kworker.0 00010000:00080000:1.0:1789578893.675060:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32d80 x1876509277103616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.675079:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277103616:0@lo:400:kworker.0 00000100:00100000:1.0:1789578893.675118:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104128 00000100:00100000:1.0:1789578893.675122:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104128 00000100:00100000:1.0:1789578893.675143:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104256 00000100:00100000:1.0:1789578893.675146:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104256 00000100:00100000:1.0:1789578893.675156:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578893.675161:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277104128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789578893.675176:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578893.675210:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277104128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.675216:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578893.675228:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578893.675233:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277104256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789578893.675248:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578893.675287:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277104256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578893.675292:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789578893.675314:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30e00 x1876509277104128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.675329:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277104128:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789578893.675373:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17100 x1876509277104256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578893.675384:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277104256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578893.678946:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277104384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578893.679266:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789578893.679416:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578893.679422:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578893.679425:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578893.679601:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104384 00000100:00100000:0.0:1789578893.679609:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104384 00000100:00100000:0.0:1789578893.679658:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578893.679667:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277104384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578893.679689:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578893.679776:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277104384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578893.679783:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789578893.679840:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17100 x1876509277104384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578893.679859:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277104384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789578894.440327:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578894.694026:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277104512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578894.694093:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578894.694170:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104512 00000100:00100000:1.0:1789578894.694178:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104512 00000100:00100000:1.0:1789578894.694222:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789578894.694231:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277104512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578894.694263:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578894.694309:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277104512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578894.694316:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789578894.694378:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277104512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578894.696166:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277104640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578894.696223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578894.696385:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104640 00000100:00100000:0.0:1789578894.696392:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104640 00000100:00100000:0.0:1789578894.696431:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789578894.696440:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277104640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578894.696470:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789578894.696536:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277104640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578894.696543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789578894.696636:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277104640:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789578895.164277:0:11340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 13:14:52 EDT 2026 00010000:00010000:2.0:1789578895.463005:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578895.476831:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578895.476871:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578895.476958:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309440 00000100:00100000:1.0:1789578895.476969:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309440 00000100:00100000:1.0:1789578895.477042:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:1.0:1789578895.477052:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261309440:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578895.477121:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261309440:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578895.477129:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:3.0:1789578895.477443:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00080000:3.0:1789578895.477460:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578895.478410:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309568 00000100:00100000:1.0:1789578895.478419:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309568 00000100:00100000:1.0:1789578895.478505:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789578895.478523:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261309568:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578895.478600:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261309568:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 87us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578895.478606:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00080000:3.0:1789578895.478891:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578895.485615:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309312 00000100:00100000:2.0:1789578895.485631:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309312 00000100:00100000:2.0:1789578895.485699:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 282 00000100:00100000:2.0:1789578895.485708:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261309312:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578895.485797:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261309312:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (8924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578895.485804:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 282 00010000:00010000:2.0:1789578896.491401:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578897.510256:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578898.533961:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578898.787567:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277104768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578898.787640:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.787719:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277105280:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.787753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.787965:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277105792:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.787996:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788117:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277106304:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788288:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788312:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789578898.788320:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277105152:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788369:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788389:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277105664:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.788409:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277105024:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788416:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788439:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277106176:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.788446:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.788472:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277105536:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788478:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788533:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104768 00000100:00100000:3.0:1789578898.788541:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104768 00000100:00100000:3.0:1789578898.788588:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789578898.788597:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277104768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789578898.788625:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578898.788665:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277104768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578898.788671:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789578898.788693:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277104896:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788720:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788741:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277105408:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.788760:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578898.788776:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277105920:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.788877:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.788897:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277106048:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.788917:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.788943:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105792 00000100:00100000:1.0:1789578898.788948:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105792 00000100:00100000:1.0:1789578898.788978:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106304 00000100:00100000:1.0:1789578898.788981:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106304 00000100:00100000:1.0:1789578898.788994:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106176 00000100:00100000:1.0:1789578898.788996:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106176 00000100:00100000:1.0:1789578898.789008:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578898.789015:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942f361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277105792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.789049:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942f361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277105792:12345-0@lo:400:kworker.0 Request processed in 33us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.789055:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789578898.789188:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789578898.789195:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277106304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.789223:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277106304:12345-0@lo:400:kworker.0 Request processed in 29us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.789229:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789578898.789239:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789578898.789257:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277106176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.789285:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277106176:12345-0@lo:400:kworker.0 Request processed in 29us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.789290:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789578898.790933:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105152 00000100:00100000:1.0:1789578898.790946:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105152 00000100:00100000:1.0:1789578898.791008:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105408 00000100:00100000:1.0:1789578898.791012:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105408 00000100:00100000:1.0:1789578898.791030:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789578898.791038:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277105152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.791107:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277105152:12345-0@lo:400:kworker.0 Request processed in 70us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.791114:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789578898.791128:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789578898.791133:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277105408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.791161:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277105408:12345-0@lo:400:kworker.0 Request processed in 28us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.791167:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789578898.791187:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105280 00000100:00100000:1.0:1789578898.791192:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105280 00000100:00100000:1.0:1789578898.791209:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105664 00000100:00100000:1.0:1789578898.791212:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105664 00000100:00100000:1.0:1789578898.791226:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105024 00000100:00100000:1.0:1789578898.791229:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105024 00000100:00100000:1.0:1789578898.791239:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105536 00000100:00100000:1.0:1789578898.791241:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105536 00000100:00100000:1.0:1789578898.791251:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106048 00000100:00100000:1.0:1789578898.791253:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106048 00000100:00100000:1.0:1789578898.791265:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789578898.791283:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277105280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.791315:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277105280:12345-0@lo:400:kworker.0 Request processed in 32us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.791320:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789578898.791332:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789578898.791338:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277105664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789578898.792170:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578898.792176:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578898.792179:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578898.792190:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578898.792220:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789578898.792230:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277105024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578898.792277:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277105024:12345-0@lo:400:kworker.0 Request processed in 50us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578898.792283:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789578898.792300:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789578898.792306:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277105536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578898.792332:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277105536:12345-0@lo:400:kworker.0 Request processed in 27us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578898.792337:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789578898.792365:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789578898.792373:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277106048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578898.792399:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277106048:12345-0@lo:400:kworker.0 Request processed in 28us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578898.792405:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789578898.792498:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277105664:12345-0@lo:400:kworker.0 Request processed in 1149us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.792507:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789578898.792532:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277104896 00000100:00100000:1.0:1789578898.792538:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277104896 00000100:00100000:1.0:1789578898.792568:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789578898.792574:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.792606:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277104896:12345-0@lo:400:kworker.0 Request processed in 33us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.792611:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789578898.792651:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.792934:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277106560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578898.792970:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.793054:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277105024:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.793068:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277105536:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793080:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31f80 x1876509277106048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793090:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277106048:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.793128:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277106432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578898.793154:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578898.793617:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277105920 00000100:00100000:1.0:1789578898.793630:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277105920 00000100:00100000:1.0:1789578898.793668:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789578898.793675:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277105920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.793717:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277105920:12345-0@lo:400:kworker.0 Request processed in 43us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578898.793723:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789578898.793744:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277106688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578898.793794:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277105152:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793808:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32300 x1876509277105664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793817:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277105664:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793828:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33800 x1876509277106176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793836:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277106176:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793845:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30000 x1876509277105792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793852:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277105792:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793862:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30700 x1876509277106304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793869:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277106304:0@lo:400:kworker.0 00000100:00100000:1.0:1789578898.793879:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277105280:0@lo:400:kworker.0 00010000:00080000:1.0:1789578898.793889:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f685180 x1876509277104768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578898.793909:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277104768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789578898.795547:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578898.800394:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277104896:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.800414:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277105408:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.800426:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277105920:0@lo:400:kworker.0 00000100:00100000:3.0:1789578898.800463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578898.804930:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106560 00000100:00100000:0.0:1789578898.804946:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106560 00000100:00100000:0.0:1789578898.805016:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106432 00000100:00100000:0.0:1789578898.805020:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106432 00000100:00100000:0.0:1789578898.805038:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789578898.805047:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277106560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578898.805079:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578898.805168:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277106560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (12197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578898.805175:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789578898.805192:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789578898.805199:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277106432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578898.805209:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578898.805247:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277106432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (12092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578898.805253:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789578898.805300:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16680 x1876509277106560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578898.805318:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277106560:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789578898.813016:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16a00 x1876509277106432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578898.813042:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277106432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578898.813201:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106688 00000100:00100000:0.0:1789578898.813209:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106688 00000100:00100000:0.0:1789578898.813265:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789578898.813274:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277106688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578898.813297:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578898.813380:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277106688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (12916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578898.813387:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789578898.813461:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15500 x1876509277106688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578898.813476:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277106688:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789578899.557287:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578899.811581:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789578899.811617:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277106816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578899.811693:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578899.811798:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106816 00000100:00100000:3.0:1789578899.811806:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106816 00000100:00100000:3.0:1789578899.811856:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789578899.811865:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277106816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578899.811895:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578899.811945:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277106816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578899.811952:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789578899.811994:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277106816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578899.812105:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277106944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578899.812131:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578899.812222:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277106944 00000100:00100000:0.0:1789578899.812228:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277106944 00000100:00100000:0.0:1789578899.812262:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789578899.812269:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277106944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578899.812287:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578899.812323:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277106944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578899.812329:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789578899.812379:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277106944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789578900.580622:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578900.602490:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578900.602530:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578900.602564:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578900.602676:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309824 00000100:00100000:1.0:1789578900.602685:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309824 00000100:00100000:1.0:1789578900.602751:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309952 00000100:00100000:1.0:1789578900.602754:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309952 00000100:00100000:1.0:1789578900.602780:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789578900.602790:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261309824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578900.602983:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261309824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 194us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578900.602991:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789578900.603006:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:1.0:1789578900.603012:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261309952:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578900.603032:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261309952:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578900.603038:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:3.0:1789578900.603382:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261309696 00000100:00100000:3.0:1789578900.603402:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261309696 00000100:00100000:3.0:1789578900.603445:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 284 00000100:00100000:3.0:1789578900.603464:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261309696:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:0.0:1789578900.603511:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578900.603516:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578900.603523:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261309696:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 50us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578900.603530:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 284 00010000:00010000:2.0:1789578901.612273:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578902.634194:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578903.651498:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578903.909299:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789578903.909322:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277107200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578903.909409:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578903.909634:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277107072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578903.909667:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578903.909704:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107200 00000100:00100000:0.0:1789578903.909711:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107200 00000100:00100000:0.0:1789578903.909756:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107072 00000100:00100000:0.0:1789578903.909760:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107072 00000100:00100000:0.0:1789578903.909780:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578903.909788:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277107200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578903.909816:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578903.909859:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277107200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578903.909878:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578903.909909:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789578903.909916:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277107072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789578903.909926:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578903.909956:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277107072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578903.909962:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789578903.909981:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789578903.910017:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f684000 x1876509277107072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578903.910036:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277107072:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789578903.910062:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16a00 x1876509277107200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578903.910073:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277107200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578903.910555:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277107712:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910594:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910613:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277108224:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910634:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910651:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277108736:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910672:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910706:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789578903.910712:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277107328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578903.910732:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910752:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277107840:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910770:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910785:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277108352:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910802:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910821:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277108864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578903.910839:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578903.910861:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108224 00000100:00100000:3.0:1789578903.910867:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108224 00000100:00100000:3.0:1789578903.910907:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107840 00000100:00100000:3.0:1789578903.910910:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107840 00000100:00100000:3.0:1789578903.910920:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108352 00000100:00100000:3.0:1789578903.910922:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108352 00000100:00100000:3.0:1789578903.910946:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789578903.910952:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.910997:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277108224:12345-0@lo:400:kworker.0 Request processed in 44us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578903.911003:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789578903.911016:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789578903.911022:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277107840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.911049:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277107840:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578903.911055:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789578903.911066:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578903.911072:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277108352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.911105:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277108352:12345-0@lo:400:kworker.0 Request processed in 23us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578903.911111:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578903.911145:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277107840:0@lo:400:kworker.0 00000100:00100000:2.0:1789578903.911380:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108736 00000100:00100000:2.0:1789578903.911385:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108736 00000100:00100000:2.0:1789578903.911413:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789578903.911420:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277108736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.911489:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107712 00000100:00100000:1.0:1789578903.911493:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107712 00000100:00100000:1.0:1789578903.911518:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789578903.911523:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277107712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.911576:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277108352:0@lo:400:kworker.0 00000100:00100000:0.0:1789578903.911619:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277107456:0@lo:400:kworker.0 00000100:00100000:2.0:1789578903.915215:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277108736:12345-0@lo:400:kworker.0 Request processed in 3786us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578903.915232:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789578903.918747:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277107712:12345-0@lo:400:kworker.0 Request processed in 7214us (8142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578903.918780:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1789578903.919085:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f590700 x1876509277108224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578903.919223:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277108224:0@lo:400:kworker.0 00010000:00080000:3.0:1789578903.919241:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4fb80 x1876509277108736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578903.919251:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277108736:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.919298:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277107712:0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.919661:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277107584:0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.919711:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578903.919795:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277108096:0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.919819:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578903.919901:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578903.919931:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277107968:0@lo:400:kworker.0 00000100:00100000:0.0:1789578903.919954:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578903.919978:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107968 00000100:00100000:0.0:1789578903.919984:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107968 00000100:00100000:0.0:1789578903.920033:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789578903.920042:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277107968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578903.920087:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277107968:12345-0@lo:400:kworker.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578903.920114:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789578903.920140:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107328 00000100:00100000:0.0:1789578903.920144:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107328 00000100:00100000:2.0:1789578903.920300:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107456 00000100:00100000:2.0:1789578903.920312:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107456 00000100:00100000:2.0:1789578903.920371:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789578903.920379:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277107456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578903.920412:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277107456:12345-0@lo:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578903.920418:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789578903.920578:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108864 00000100:00100000:0.0:1789578903.920582:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108864 00000100:00100000:0.0:1789578903.920595:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789578903.920600:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277107328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578903.920622:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578903.920655:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277107328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (9922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578903.920661:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789578903.920671:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789578903.920675:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277108864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578903.920683:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578903.920700:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277108864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 25us (9861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578903.920705:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789578903.920717:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789578903.920721:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578903.920724:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789578903.920742:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277107968:0@lo:400:kworker.0 00000100:00100000:0.0:1789578903.920749:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277108480:0@lo:400:kworker.0 00010000:00080000:2.0:1789578903.920848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b17100 x1876509277107328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578903.920863:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277107328:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789578903.920872:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362be300 x1876509277108864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578903.920882:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277108864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578903.921893:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277108608:0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.921932:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578903.921965:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108608 00000100:00100000:1.0:1789578903.921970:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108608 00000100:00100000:0.0:1789578903.922071:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578903.922116:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789578903.922125:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277108608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.922395:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277108608:12345-0@lo:400:kworker.0 Request processed in 271us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578903.922402:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789578903.922438:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437389880 x1876509277108608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578903.922461:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277108608:0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.925301:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277107584 00000100:00100000:3.0:1789578903.925316:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277107584 00000100:00100000:3.0:1789578903.925403:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108096 00000100:00100000:3.0:1789578903.925406:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108096 00000100:00100000:3.0:1789578903.925441:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789578903.925449:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277107584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.925547:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277107584:12345-0@lo:400:kworker.0 Request processed in 98us (5835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578903.925554:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789578903.925570:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789578903.925576:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578903.925600:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277108096:12345-0@lo:400:kworker.0 Request processed in 26us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578903.925606:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789578903.925630:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578903.925737:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277107584:0@lo:400:kworker.0 00000100:00100000:1.0:1789578903.925749:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277108096:0@lo:400:kworker.0 00000100:00100000:0.0:1789578903.929539:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277107456:0@lo:400:kworker.0 00000100:00100000:2.0:1789578903.930086:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108480 00000100:00100000:2.0:1789578903.930217:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108480 00000100:00100000:2.0:1789578903.931134:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789578903.931146:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277108480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578903.931693:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277108480:12345-0@lo:400:kworker.0 Request processed in 548us (9621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578903.931701:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1789578903.931752:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943738bb80 x1876509277108480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578903.931766:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277108480:0@lo:400:kworker.0 00000100:00080000:1.0:1789578903.935264:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789578904.679513:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578904.931625:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789578904.931649:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277108992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578904.931730:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578904.931856:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277108992 00000100:00100000:3.0:1789578904.931864:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277108992 00000100:00100000:3.0:1789578904.931920:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789578904.931932:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277108992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578904.931972:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578904.932023:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277108992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578904.932030:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789578904.932085:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277108992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578904.936610:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578904.936646:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277109120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578904.936714:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578904.936806:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109120 00000100:00100000:1.0:1789578904.936815:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109120 00000100:00100000:1.0:1789578904.936908:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789578904.936918:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277109120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578904.936955:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578904.937000:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277109120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578904.937007:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789578904.937062:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277109120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789578905.699667:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578905.722592:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578905.722717:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578905.722745:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578905.722772:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310336 00000100:00100000:0.0:1789578905.722781:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310336 00000100:00100000:0.0:1789578905.722836:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310208 00000100:00100000:0.0:1789578905.722840:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310208 00000100:00100000:0.0:1789578905.722866:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:0.0:1789578905.722876:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261310336:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578905.722947:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261310336:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578905.722954:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:1.0:1789578905.722960:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:1.0:1789578905.722969:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261310208:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578905.722997:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261310208:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578905.723004:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00080000:1.0:1789578905.723021:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578905.723024:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578905.723780:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310080 00000100:00100000:3.0:1789578905.723792:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310080 00000100:00100000:3.0:1789578905.723831:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 286 00000100:00100000:3.0:1789578905.723839:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261310080:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578905.723921:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261310080:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 82us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578905.723927:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 286 00010000:00010000:2.0:1789578906.725491:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578907.749464:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578908.778120:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578909.027640:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277109376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578909.027705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578909.027772:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789578909.027778:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277109248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578909.027801:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.028048:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109376 00000100:00100000:2.0:1789578909.028066:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109376 00000100:00100000:2.0:1789578909.028125:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109248 00000100:00100000:2.0:1789578909.028128:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109248 00000100:00100000:2.0:1789578909.028148:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789578909.028157:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277109376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789578909.028186:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578909.028235:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277109376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.028242:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789578909.028258:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789578909.028264:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277109248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578909.028274:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578909.028297:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277109248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.028303:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789578909.028341:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362be300 x1876509277109248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578909.028384:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277109248:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789578909.028397:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4df80 x1876509277109376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578909.028408:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277109376:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789578909.028511:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578909.030405:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277109888:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030476:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.030507:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277110400:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030533:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.030567:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789578909.030587:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277109760:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030613:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.030633:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277110272:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030653:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.030670:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277110784:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.030719:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109888 00000100:00100000:2.0:1789578909.030725:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109888 00000100:00100000:2.0:1789578909.030762:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110272 00000100:00100000:2.0:1789578909.030765:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110272 00000100:00100000:2.0:1789578909.030788:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110784 00000100:00100000:2.0:1789578909.030791:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110784 00000100:00100000:2.0:1789578909.030806:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789578909.030814:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030862:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277109888:12345-0@lo:400:kworker.0 Request processed in 47us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.030869:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789578909.030884:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789578909.030891:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277110272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030929:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277110272:12345-0@lo:400:kworker.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.030935:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789578909.030946:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789578909.030951:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277110784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.030977:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277110784:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.030994:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789578909.031014:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110400 00000100:00100000:2.0:1789578909.031018:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110400 00000100:00100000:2.0:1789578909.031043:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789578909.031049:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277110400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.031080:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277110400:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.031086:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789578909.031105:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109760 00000100:00100000:2.0:1789578909.031109:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109760 00000100:00100000:2.0:1789578909.031130:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789578909.031137:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.031165:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277109760:12345-0@lo:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.031170:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1789578909.031193:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789578909.031197:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578909.031222:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277109760:0@lo:400:kworker.0 00010000:00080000:2.0:1789578909.031234:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bed80 x1876509277110272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578909.031243:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277110272:0@lo:400:kworker.0 00010000:00080000:2.0:1789578909.031250:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bd180 x1876509277110784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578909.031258:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277110784:0@lo:400:kworker.0 00000100:00100000:2.0:1789578909.031265:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277109888:0@lo:400:kworker.0 00010000:00080000:2.0:1789578909.031281:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bea00 x1876509277110400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578909.031289:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277110400:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031495:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277109632:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031524:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031548:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277110144:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031567:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031601:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277110656:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031620:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031640:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789578909.031646:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277109504:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031668:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031688:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277110016:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031708:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031726:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277110528:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031747:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.031775:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109632 00000100:00100000:3.0:1789578909.031779:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109632 00000100:00100000:3.0:1789578909.031798:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110144 00000100:00100000:3.0:1789578909.031800:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110144 00000100:00100000:3.0:1789578909.031815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110656 00000100:00100000:3.0:1789578909.031817:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110656 00000100:00100000:3.0:1789578909.031829:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789578909.031841:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031876:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277109632:12345-0@lo:400:kworker.0 Request processed in 34us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.031882:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789578909.031895:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789578909.031911:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277110144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031939:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277110144:12345-0@lo:400:kworker.0 Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.031945:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789578909.031955:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789578909.031961:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277110656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.031985:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277110656:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.031990:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789578909.032006:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277109504 00000100:00100000:3.0:1789578909.032009:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277109504 00000100:00100000:3.0:1789578909.032034:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789578909.032040:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277109504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032068:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277109504:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.032073:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789578909.032096:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110016 00000100:00100000:3.0:1789578909.032100:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110016 00000100:00100000:3.0:1789578909.032122:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789578909.032128:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032155:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277110016:12345-0@lo:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.032167:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789578909.032185:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110528 00000100:00100000:3.0:1789578909.032189:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110528 00000100:00100000:3.0:1789578909.032214:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578909.032220:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277110528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032248:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277110528:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.032254:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789578909.032279:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277109504:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032289:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277110016:0@lo:400:kworker.0 00010000:00080000:3.0:1789578909.032299:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bca80 x1876509277110528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578909.032307:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277110528:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032316:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277109632:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032325:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277110144:0@lo:400:kworker.0 00000100:00100000:3.0:1789578909.032334:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277110656:0@lo:400:kworker.0 00000100:00080000:3.0:1789578909.032396:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578909.032400:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578909.035933:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578909.035954:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578909.036014:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578909.036059:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111040 00000100:00100000:3.0:1789578909.036066:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111040 00000100:00100000:3.0:1789578909.036116:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789578909.036125:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277111040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789578909.036152:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578909.036196:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277111040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578909.036203:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789578909.036237:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930289f100 x1876509277111040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578909.036254:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578909.037479:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578909.037497:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277110912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578909.037543:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578909.037707:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277110912 00000100:00100000:2.0:1789578909.037713:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277110912 00000100:00100000:2.0:1789578909.037757:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789578909.037767:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277110912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578909.037784:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578909.037827:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277110912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578909.037834:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789578909.038575:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437388000 x1876509277110912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578909.038616:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277110912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789578909.796548:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578910.051589:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277111168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578910.051670:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578910.051793:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111168 00000100:00100000:3.0:1789578910.051802:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111168 00000100:00100000:3.0:1789578910.051872:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789578910.051884:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277111168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578910.051922:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578910.051986:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277111168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578910.051993:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789578910.052180:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277111168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578910.052597:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578910.052608:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277111296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578910.052640:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578910.052719:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111296 00000100:00100000:2.0:1789578910.052724:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111296 00000100:00100000:2.0:1789578910.052753:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789578910.052760:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277111296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789578910.052782:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789578910.052840:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277111296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578910.052847:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789578910.053090:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277111296:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789578910.820787:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578910.837490:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578910.837539:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578910.837615:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578910.837736:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310464 00000100:00100000:3.0:1789578910.837752:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310464 00000100:00100000:3.0:1789578910.837822:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 288 00000100:00100000:3.0:1789578910.837846:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2392:x1876509261310464:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578910.837958:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2392:x1876509261310464:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 115us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578910.837967:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 288 00000100:00100000:2.0:1789578910.846121:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310720 00000100:00100000:2.0:1789578910.846147:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310720 00000100:00100000:2.0:1789578910.846392:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310592 00000100:00100000:2.0:1789578910.846397:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310592 00000100:00100000:2.0:1789578910.846451:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:2.0:1789578910.846464:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261310720:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578910.846606:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261310720:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 144us (9065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578910.846614:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:2.0:1789578910.846635:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:2.0:1789578910.846653:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261310592:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578910.846679:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261310592:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578910.846686:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00080000:3.0:1789578910.847764:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578910.847775:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789578911.845626:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789578912.624402:0:11969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:15:09 (1789578909) === 00010000:00010000:1.0:1789578912.881234:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578913.230317:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.230685:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310848 00000100:00100000:1.0:1789578913.230699:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310848 00000100:00100000:1.0:1789578913.230783:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:1.0:1789578913.230797:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:8712:x1876509261310848:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789578913.230819:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578913.230854:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2fa00/0xd90373d592f20de5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe0a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.230893:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2fa00/0xd90373d592f20de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe0a expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.230905:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2fa00/0xd90373d592f20de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe0a expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.231116:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2fa00, rc 0) 00000100:00100000:1.0:1789578913.231189:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261310848:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 396us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.231197:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:2.0:1789578913.237138:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578913.237247:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261310976 00000100:00100000:3.0:1789578913.237261:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261310976 00000100:00100000:3.0:1789578913.237335:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 290 00000100:00100000:3.0:1789578913.237347:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261310976:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789578913.237620:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261310976:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 274us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.237628:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 290 00000100:00100000:0.0:1789578913.257958:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.258245:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311104 00000100:00100000:1.0:1789578913.258255:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311104 00000100:00100000:1.0:1789578913.258316:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 291 00000100:00100000:1.0:1789578913.258326:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261311104:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789578913.258524:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261311104:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 199us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.258541:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 291 00000100:00100000:0.0:1789578913.269238:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.271526:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311232 00000100:00100000:1.0:1789578913.271543:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311232 00000100:00100000:1.0:1789578913.271610:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 292 00000100:00100000:1.0:1789578913.271621:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311232:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789578913.274770:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311232:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 3137us (5531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.274786:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 292 00000100:00100000:0.0:1789578913.321442:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578913.321528:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311360 00000100:00100000:3.0:1789578913.321538:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311360 00000100:00100000:3.0:1789578913.321596:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 293 00000100:00100000:3.0:1789578913.321606:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311360:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789578913.321759:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311360:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 154us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.321768:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 293 00000100:00100000:2.0:1789578913.340638:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578913.340901:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311488 00000100:00100000:3.0:1789578913.340920:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311488 00000100:00100000:3.0:1789578913.340977:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 294 00000100:00100000:3.0:1789578913.340987:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311488:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789578913.341129:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8716:x1876509261311488:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.341137:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 294 00000100:00100000:0.0:1789578913.345448:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.346546:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311616 00000100:00100000:1.0:1789578913.346557:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311616 00000100:00100000:1.0:1789578913.346601:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 295 00000100:00100000:1.0:1789578913.346609:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:8712:x1876509261311616:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789578913.346623:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578913.346638:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e000/0xd90373d592f20dec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe3b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.346664:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e000/0xd90373d592f20dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe3b expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.346674:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e000/0xd90373d592f20dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe3b expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.346682:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e000, rc 0) 00000100:00100000:1.0:1789578913.346735:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:8712:x1876509261311616:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 126us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.346741:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 295 00000100:00100000:2.0:1789578913.354893:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.354987:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311744 00000100:00100000:0.0:1789578913.354998:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311744 00000100:00100000:0.0:1789578913.355072:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 296 00000100:00100000:0.0:1789578913.355083:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:8712:x1876509261311744:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789578913.355110:0:6484:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789578913.355135:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789578913.355140:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789578913.355143:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789578913.355146:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789578913.355148:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789578913.356973:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:8712:x1876509261311744:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 1882us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.356987:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 296 00000100:00100000:3.0:1789578913.360560:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.360689:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261311872 00000100:00100000:1.0:1789578913.360704:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261311872 00000100:00100000:1.0:1789578913.361616:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 297 00000100:00100000:1.0:1789578913.361640:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:8712:x1876509261311872:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789578913.361664:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578913.361691:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe42 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.361730:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.361743:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578913.361753:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ec00, rc 0) 00000100:00100000:1.0:1789578913.362668:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8712:x1876509261311872:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 1016us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.362686:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 297 00000100:00100000:2.0:1789578913.367216:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.367402:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312000 00000100:00100000:0.0:1789578913.367423:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312000 00000100:00100000:0.0:1789578913.367506:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 298 00000100:00100000:0.0:1789578913.367518:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8712:x1876509261312000:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789578913.367729:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8712:x1876509261312000:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 212us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.367737:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 298 00000100:00100000:2.0:1789578913.374608:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.375052:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312128 00000100:00100000:1.0:1789578913.375065:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312128 00000100:00100000:1.0:1789578913.375132:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:1.0:1789578913.375143:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8712:x1876509261312128:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789578913.375562:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8712:x1876509261312128:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 418us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.375571:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:1.0:1789578913.384046:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578913.384181:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312256 00000100:00100000:3.0:1789578913.384195:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312256 00000100:00100000:3.0:1789578913.384258:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 300 00000100:00100000:3.0:1789578913.384286:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8722:x1876509261312256:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789578913.384543:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8722:x1876509261312256:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 258us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.384551:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 300 00000100:00100000:2.0:1789578913.401819:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.402219:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312384 00000100:00100000:1.0:1789578913.402251:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312384 00000100:00100000:1.0:1789578913.402328:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 301 00000100:00100000:1.0:1789578913.402340:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8722:x1876509261312384:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789578913.402587:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:8722:x1876509261312384:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 248us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.402595:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 301 00000100:00100000:2.0:1789578913.413727:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578913.413777:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.413888:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313280 00000100:00100000:0.0:1789578913.413901:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313280 00000100:00100000:0.0:1789578913.414016:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313152 00000100:00100000:0.0:1789578913.414020:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313152 00000100:00100000:0.0:1789578913.414050:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:0.0:1789578913.414064:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261313280:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578913.414154:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261313280:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 94us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.414162:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:0.0:1789578913.414184:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:0.0:1789578913.414190:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261313152:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578913.414215:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261313152:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.414221:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00080000:2.0:1789578913.415346:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578913.415400:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578913.416549:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578913.416624:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.416790:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312512 00000100:00100000:0.0:1789578913.416801:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312512 00000100:00100000:0.0:1789578913.416854:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312768 00000100:00100000:0.0:1789578913.416857:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312768 00000100:00100000:0.0:1789578913.416880:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789578913.416889:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1876509261312512:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789578913.416932:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from eb97d94f-5343-4111-9eea-cc9a295afa74@192.168.203.37@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1789578913.416976:0:6491:0:(genops.c:1384:class_connect()) connect: client eb97d94f-5343-4111-9eea-cc9a295afa74, cookie 0xd90373d592f20dfa 00000004:00100000:0.0:1789578913.417008:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789578913.417150:0:6491:0:(import.c:65:import_set_state_nolock()) ffff93943f586000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578913.417218:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2391:x1876509261312512:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 329us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.417225:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789578913.417243:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789578913.417261:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1876509261312768:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789578913.417277:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from eb97d94f-5343-4111-9eea-cc9a295afa74@192.168.203.37@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1789578913.417302:0:6491:0:(genops.c:1384:class_connect()) connect: client eb97d94f-5343-4111-9eea-cc9a295afa74, cookie 0xd90373d592f20e01 00000004:00100000:0.0:1789578913.417314:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789578913.417413:0:6491:0:(import.c:65:import_set_state_nolock()) ffff93943f582800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789578913.417438:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2391:x1876509261312768:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 175us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.417445:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789578913.430834:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.430876:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.430909:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578913.431054:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313024 00000100:00100000:2.0:1789578913.431067:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313024 00000100:00100000:2.0:1789578913.431141:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312896 00000100:00100000:2.0:1789578913.431144:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312896 00000100:00100000:2.0:1789578913.431158:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261312640 00000100:00100000:2.0:1789578913.431176:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261312640 00000100:00100000:2.0:1789578913.431192:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789578913.431202:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+7:8712:x1876509261313024:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789578913.431249:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578913.431397:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+7:8712:x1876509261313024:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 194us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578913.431406:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789578913.431426:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789578913.431433:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:0:x1876509261312896:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789578913.431454:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789578913.431492:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:0:x1876509261312896:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 60us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578913.431509:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789578913.431522:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789578913.431528:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:0:x1876509261312640:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789578913.431538:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578913.431559:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:0:x1876509261312640:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578913.431565:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00080000:0.0:1789578913.432346:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578913.432394:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578913.435726:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.435930:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313408 00000100:00100000:0.0:1789578913.435943:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313408 00000100:00100000:0.0:1789578913.436060:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789578913.436072:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313408:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789578913.436185:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313408:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 115us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578913.436193:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789578913.444731:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.444873:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313792 00000100:00100000:1.0:1789578913.444888:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313792 00000100:00100000:1.0:1789578913.444966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789578913.444977:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313792:12345-192.168.203.37@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789578913.445083:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313792:12345-192.168.203.37@tcp:900:mount.lustre.0 Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578913.445091:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789578913.447590:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.447653:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578913.447691:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578913.448642:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313920 00000100:00100000:0.0:1789578913.448655:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313920 00000100:00100000:0.0:1789578913.448732:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789578913.448743:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313920:12345-192.168.203.37@tcp:33:mount.lustre.0 00000100:00100000:2.0:1789578913.449212:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313536 00000100:00100000:2.0:1789578913.449219:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313536 00000100:00100000:2.0:1789578913.449254:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261313664 00000100:00100000:2.0:1789578913.449258:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261313664 00000100:00100000:2.0:1789578913.449275:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789578913.449402:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261313536:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789578913.449443:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from eb97d94f-5343-4111-9eea-cc9a295afa74@192.168.203.37@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789578913.449478:0:8405:0:(genops.c:1384:class_connect()) connect: client eb97d94f-5343-4111-9eea-cc9a295afa74, cookie 0xd90373d592f20e08 00002000:00100000:2.0:1789578913.449493:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb97d94f-5343-4111-9eea-cc9a295afa74/ffff939304092000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000004:00200000:0.0:1789578913.449659:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789578913.449777:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:8712:x1876509261313920:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 1034us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.450188:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789578913.450196:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1876509261313664:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789578913.450221:0:10029:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from eb97d94f-5343-4111-9eea-cc9a295afa74@192.168.203.37@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1789578913.450243:0:10029:0:(genops.c:1384:class_connect()) connect: client eb97d94f-5343-4111-9eea-cc9a295afa74, cookie 0xd90373d592f20e0f 00002000:00100000:3.0:1789578913.450250:0:10029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eb97d94f-5343-4111-9eea-cc9a295afa74/ffff93943f642000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789578913.450272:0:10029:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789578913.450409:0:10029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789578913.450446:0:10029:0:(import.c:65:import_set_state_nolock()) ffff93943f645800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578913.450488:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2391:x1876509261313664:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 291us (2834us total) trans 0 rc 0/0 00002000:00100000:2.0:1789578913.452628:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789578913.452750:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789578913.453246:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00080000:2.0:1789578913.455172:0:8405:0:(import.c:65:import_set_state_nolock()) ffff939304090800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578913.455295:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2391:x1876509261313536:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 5888us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578913.456429:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789578913.456690:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00010000:00010000:0.0:1789578913.892120:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578914.147975:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277111424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578914.148578:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578914.148744:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578914.148787:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578914.148851:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277111680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578914.148875:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578914.148920:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111424 00000100:00100000:1.0:1789578914.148930:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111424 00000100:00100000:1.0:1789578914.148988:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111552 00000100:00100000:1.0:1789578914.148990:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111552 00000100:00100000:1.0:1789578914.149024:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111680 00000100:00100000:1.0:1789578914.149027:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111680 00000100:00100000:1.0:1789578914.149044:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789578914.149053:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277111424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789578914.149871:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578914.150264:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277111424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1208us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578914.150275:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789578914.150312:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789578914.150325:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277111552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789578914.150342:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578914.150401:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277111552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578914.150408:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789578914.150534:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789578914.150545:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277111680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578914.150559:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578914.150600:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277111680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578914.150606:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789578914.150659:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e6300 x1876509277111680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578914.150684:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277111680:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789578914.150806:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e6680 x1876509277111552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578914.150822:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277111552:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789578914.150849:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a48e00 x1876509277111424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578914.150879:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277111424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578914.150892:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578914.150901:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277111808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578914.150951:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578914.150981:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111808 00000100:00100000:2.0:1789578914.150989:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111808 00000100:00100000:2.0:1789578914.151032:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789578914.151039:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277111808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578914.151050:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789578914.152003:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789578914.152014:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578914.152260:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277111808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1217us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578914.152270:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789578914.152478:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bdc00 x1876509277111808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578914.152502:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277111808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578914.158631:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578914.158779:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277112064:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.158878:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.158957:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578914.158964:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277112192:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.159023:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.159068:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112192 00000100:00100000:3.0:1789578914.159091:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112192 00000100:00100000:3.0:1789578914.159154:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789578914.159165:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277112192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.159240:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277112192:12345-0@lo:400:kworker.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.159249:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789578914.159278:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112064 00000100:00100000:3.0:1789578914.159282:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112064 00000100:00100000:3.0:1789578914.159315:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789578914.159322:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277112064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.159391:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277112064:12345-0@lo:400:kworker.0 Request processed in 69us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.159397:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789578914.159450:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277112192:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.159461:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277112064:0@lo:400:kworker.0 00000100:00100000:2.0:1789578914.161822:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578914.161859:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277112320:0@lo:400:kworker.0 00000100:00100000:2.0:1789578914.161959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.162403:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112320 00000100:00100000:3.0:1789578914.162423:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112320 00000100:00100000:3.0:1789578914.162495:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789578914.162507:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277112320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.162580:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277112320:12345-0@lo:400:kworker.0 Request processed in 75us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.162587:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789578914.162739:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277112320:0@lo:400:kworker.0 00000100:00100000:1.0:1789578914.164043:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277111936:0@lo:400:kworker.0 00000100:00100000:1.0:1789578914.164254:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.164399:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277111936 00000100:00100000:3.0:1789578914.164407:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277111936 00000100:00100000:3.0:1789578914.164533:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789578914.164544:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277111936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.165922:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277111936:12345-0@lo:400:kworker.0 Request processed in 1373us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.165959:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789578914.167325:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277112576:0@lo:400:kworker.0 00000100:00100000:1.0:1789578914.167447:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578914.167493:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789578914.167498:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277112704:0@lo:400:kworker.0 00000100:00100000:1.0:1789578914.167522:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.167920:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112576 00000100:00100000:3.0:1789578914.167930:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112576 00000100:00100000:3.0:1789578914.168008:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112704 00000100:00100000:3.0:1789578914.168012:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112704 00000100:00100000:3.0:1789578914.168040:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789578914.168052:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277112576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168313:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277112576:12345-0@lo:400:kworker.0 Request processed in 264us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.168322:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789578914.168342:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789578914.168373:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277112704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168423:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277112704:12345-0@lo:400:kworker.0 Request processed in 66us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.168430:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1789578914.168482:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437356300 x1876509277112704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578914.168498:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277112704:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168512:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277112576:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168541:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277112448:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168575:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.168597:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277112960:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168618:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.168637:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789578914.168657:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277112832:0@lo:400:kworker.0 00000100:00100000:3.0:1789578914.168679:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578914.168704:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112448 00000100:00100000:3.0:1789578914.168709:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112448 00000100:00100000:3.0:1789578914.168736:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789578914.168742:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277112448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578914.168936:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112960 00000100:00100000:0.0:1789578914.168942:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112960 00000100:00100000:0.0:1789578914.168969:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277112832 00000100:00100000:0.0:1789578914.168971:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277112832 00000100:00100000:0.0:1789578914.168986:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789578914.168993:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277112960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789578914.169057:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578914.169063:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578914.173687:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277112960:12345-0@lo:400:kworker.0 Request processed in 4679us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578914.173727:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789578914.173788:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789578914.173804:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578914.173870:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277112832:12345-0@lo:400:kworker.0 Request processed in 73us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578914.173877:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789578914.174941:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277112448:12345-0@lo:400:kworker.0 Request processed in 6189us (6356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578914.174956:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789578914.176031:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277112832:0@lo:400:kworker.0 00000100:00100000:0.0:1789578914.176050:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277112448:0@lo:400:kworker.0 00010000:00080000:0.0:1789578914.176067:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9880 x1876509277112960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578914.176279:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277112960:0@lo:400:kworker.0 00000100:00100000:2.0:1789578914.177580:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277111936:0@lo:400:kworker.0 00010000:00010000:0.0:1789578914.916013:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578915.171482:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578915.171505:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277113088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578915.171569:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578915.172520:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578915.172534:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277113216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578915.172579:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578915.172613:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113088 00000100:00100000:3.0:1789578915.172620:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113088 00000100:00100000:3.0:1789578915.172675:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113216 00000100:00100000:3.0:1789578915.172678:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113216 00000100:00100000:3.0:1789578915.172695:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789578915.172704:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277113088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578915.172745:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578915.172786:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277113088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578915.172794:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789578915.172809:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789578915.172815:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277113216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578915.172830:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578915.172863:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277113216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578915.172879:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789578915.173140:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277113216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578915.175053:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277113088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789578915.943300:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578916.964556:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578917.987788:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578918.519481:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519542:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519813:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519849:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519871:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519895:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519919:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578918.519960:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314688 00000100:00100000:1.0:1789578918.519973:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314688 00000100:00100000:1.0:1789578918.520054:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314816 00000100:00100000:1.0:1789578918.520058:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314816 00000100:00100000:1.0:1789578918.520087:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789578918.520100:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2392:x1876509261314688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520206:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314048 00000100:00100000:1.0:1789578918.520224:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2392:x1876509261314688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578918.520227:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314048 00000100:00100000:1.0:1789578918.520238:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789578918.520266:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789578918.520277:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2393:x1876509261314816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520319:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 303 00000100:00100000:1.0:1789578918.520332:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2393:x1876509261314816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 56us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578918.520341:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:3.0:1789578918.520393:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261314048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520472:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261314048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 142us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578918.520480:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 303 00000100:00100000:2.0:1789578918.520523:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314176 00000100:00100000:2.0:1789578918.520531:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314176 00000100:00100000:3.0:1789578918.520533:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314432 00000100:00100000:3.0:1789578918.520541:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314432 00000100:00100000:3.0:1789578918.520579:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314304 00000100:00100000:3.0:1789578918.520584:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314304 00000100:00100000:2.0:1789578918.520586:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314560 00000100:00100000:2.0:1789578918.520601:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314560 00000100:00100000:3.0:1789578918.520622:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:3.0:1789578918.520635:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2392:x1876509261314432:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578918.520645:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:2.0:1789578918.520659:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261314176:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520677:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2392:x1876509261314432:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 44us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578918.520685:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:3.0:1789578918.520704:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:3.0:1789578918.520713:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261314304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520743:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261314304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 33us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578918.520749:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:3.0:1789578918.520761:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:3.0:1789578918.520783:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2393:x1876509261314560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578918.520810:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2393:x1876509261314560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578918.520818:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:2.0:1789578918.520849:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261314176:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 192us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578918.520859:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00080000:2.0:1789578918.520932:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578918.520938:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578918.520940:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578918.520943:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789578918.766247:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00100000:3.0:1789578918.766576:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00100000:3.0:1789578918.772554:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00100000:0.0:1789578918.772796:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00010000:00010000:0.0:1789578919.011598:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578919.269495:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277113344:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.269608:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578919.269682:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578919.269689:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277113472:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.269721:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578919.269753:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277113600:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.269935:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578919.270022:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277114112:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.270060:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277113984:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.270105:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.270138:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277114496:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.270142:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578919.270181:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277114624:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.270196:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.273648:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578919.273735:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.273764:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789578919.273772:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277113856:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.273810:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.273838:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277114368:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.273864:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.273890:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277114880:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.273939:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.273961:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578919.273982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274021:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277113728:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274051:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274064:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277114240:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274082:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274099:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277114752:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274116:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274130:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578919.274145:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274167:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578919.274172:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578919.274189:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578919.274215:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113472 00000100:00100000:0.0:1789578919.274232:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113472 00000100:00100000:0.0:1789578919.274283:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113984 00000100:00100000:0.0:1789578919.274287:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113984 00000100:00100000:0.0:1789578919.274315:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114112 00000100:00100000:0.0:1789578919.274319:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114112 00000100:00100000:0.0:1789578919.274332:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114496 00000100:00100000:0.0:1789578919.274334:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114496 00000100:00100000:0.0:1789578919.274616:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113728 00000100:00100000:0.0:1789578919.274621:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113728 00000100:00100000:0.0:1789578919.274637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789578919.274646:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277113472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274712:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277113472:12345-0@lo:400:kworker.0 Request processed in 67us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.274720:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789578919.274740:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789578919.274747:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277113984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274786:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277113984:12345-0@lo:400:kworker.0 Request processed in 40us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.274805:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789578919.274817:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789578919.274824:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277114112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274856:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277114112:12345-0@lo:400:kworker.0 Request processed in 32us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.274862:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789578919.274872:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789578919.274878:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277114496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.274965:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277114496:12345-0@lo:400:kworker.0 Request processed in 82us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.274981:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789578919.274994:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789578919.275001:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.275041:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277113728:12345-0@lo:400:kworker.0 Request processed in 41us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.275047:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789578919.275071:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114368 00000100:00100000:0.0:1789578919.275075:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114368 00000100:00100000:0.0:1789578919.275099:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114880 00000100:00100000:0.0:1789578919.275101:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114880 00000100:00100000:0.0:1789578919.275112:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114240 00000100:00100000:0.0:1789578919.275114:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114240 00000100:00100000:0.0:1789578919.275124:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114752 00000100:00100000:0.0:1789578919.275127:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114752 00000100:00100000:0.0:1789578919.275140:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578919.275145:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277114368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.275519:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277114368:12345-0@lo:400:kworker.0 Request processed in 370us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578919.275527:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578919.275630:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115008 00000100:00100000:1.0:1789578919.275636:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115008 00000100:00100000:1.0:1789578919.275670:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115392 00000100:00100000:1.0:1789578919.275673:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115392 00000100:00100000:1.0:1789578919.275691:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115264 00000100:00100000:1.0:1789578919.275695:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115264 00000100:00100000:1.0:1789578919.275706:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115136 00000100:00100000:1.0:1789578919.275709:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115136 00000100:00100000:1.0:1789578919.275723:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789578919.275730:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277115008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578919.275771:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578919.275829:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277115008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.275836:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789578919.275849:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789578919.275856:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277115392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789578919.275880:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578919.275913:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277115392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.275919:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789578919.275931:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789578919.275936:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277115264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789578919.275949:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578919.275974:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277115264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.275992:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789578919.276004:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578919.276010:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277115136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789578919.276020:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578919.276046:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277115136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.276052:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578919.276076:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578919.276084:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277114880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578919.276117:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277114880:12345-0@lo:400:kworker.0 Request processed in 35us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.276123:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578919.276137:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789578919.276143:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277114240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578919.276169:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277114240:12345-0@lo:400:kworker.0 Request processed in 27us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.276174:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789578919.276184:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789578919.276191:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277114752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578919.276222:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277114752:12345-0@lo:400:kworker.0 Request processed in 31us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578919.276227:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789578919.276645:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789578919.276651:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578919.276654:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578919.276658:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789578919.276717:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350f800 x1876509277115136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.276742:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578919.276765:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277113728:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.276789:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5eb800 x1876509277114240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578919.276924:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113600 00000100:00100000:2.0:1789578919.276933:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113600 00000100:00100000:2.0:1789578919.276979:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113856 00000100:00100000:2.0:1789578919.276983:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113856 00000100:00100000:2.0:1789578919.276997:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578919.277004:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277113600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578919.277062:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277113600:12345-0@lo:400:kworker.0 Request processed in 58us (7134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578919.277073:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578919.277087:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789578919.277092:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578919.277122:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277113856:12345-0@lo:400:kworker.0 Request processed in 30us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578919.277127:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789578919.277177:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277114240:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.277194:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5eaa00 x1876509277114752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.277201:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277114752:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.277211:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350ce00 x1876509277115264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.277221:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578919.277284:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277113856:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.277299:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8e00 x1876509277114368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578919.277445:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277113344 00000100:00100000:2.0:1789578919.277451:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277113344 00000100:00100000:2.0:1789578919.277490:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789578919.277497:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277113344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578919.277563:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277113344:12345-0@lo:400:kworker.0 Request processed in 67us (7956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578919.277570:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789578919.277620:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277113472:0@lo:400:kworker.0 00000100:00100000:2.0:1789578919.277630:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277113344:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.277939:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277114368:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.277960:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8a80 x1876509277114880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.277968:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277114880:0@lo:400:kworker.0 00010000:00080000:0.0:1789578919.277979:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350e300 x1876509277115392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.277994:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115392:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789578919.278005:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b30380 x1876509277115008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578919.278037:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578919.278055:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277113984:0@lo:400:kworker.0 00000100:00100000:0.0:1789578919.278068:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277114496:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.278449:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578919.278598:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277114624 00000100:00100000:3.0:1789578919.278610:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277114624 00000100:00100000:3.0:1789578919.278690:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789578919.278700:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277114624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.278759:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277114624:12345-0@lo:400:kworker.0 Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578919.278766:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1789578919.278813:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789578919.279183:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9180 x1876509277114624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578919.279200:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277114624:0@lo:400:kworker.0 00010000:00080000:3.0:1789578919.279218:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ebb80 x1876509277114112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578919.279227:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277114112:0@lo:400:kworker.0 00000100:00100000:3.0:1789578919.279240:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277113600:0@lo:400:kworker.0 00000001:02000400:3.0:1789578919.624747:0:12162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789578920.036132:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578920.294554:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578920.295871:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578920.295991:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115520 00000100:00100000:1.0:1789578920.296003:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115520 00000100:00100000:1.0:1789578920.296059:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789578920.296070:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277115520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578920.298237:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578920.298402:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277115520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2327us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578920.298414:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789578920.298640:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578920.298663:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578920.298718:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578920.298801:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277115520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578920.299514:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115648 00000100:00100000:1.0:1789578920.299526:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115648 00000100:00100000:1.0:1789578920.299591:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789578920.299602:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277115648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578920.299648:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789578920.299724:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277115648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578920.299731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789578920.299787:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277115648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789578921.068669:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578922.083776:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578923.108518:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578923.661593:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578923.661636:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578923.661853:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578923.662015:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261314944 00000100:00100000:3.0:1789578923.662025:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261314944 00000100:00100000:3.0:1789578923.662076:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 305 00000100:00100000:3.0:1789578923.662087:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261314944:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578923.662157:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261314944:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 71us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578923.662164:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 305 00000100:00100000:1.0:1789578923.662413:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578923.662436:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578923.662475:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315712 00000100:00100000:3.0:1789578923.662479:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315712 00000100:00100000:3.0:1789578923.662520:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:3.0:1789578923.662527:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315712:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578923.662562:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315712:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578923.662580:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00080000:3.0:1789578923.662597:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789578923.667825:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578923.672997:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315200 00000100:00100000:2.0:1789578923.673014:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315200 00000100:00100000:2.0:1789578923.673093:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315456 00000100:00100000:2.0:1789578923.673096:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315456 00000100:00100000:2.0:1789578923.673113:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315072 00000100:00100000:2.0:1789578923.673116:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315072 00000100:00100000:2.0:1789578923.673139:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:2.0:1789578923.673148:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261315200:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578923.673226:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261315200:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 79us (11588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578923.673232:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:2.0:1789578923.673250:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:2.0:1789578923.673257:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315456:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578923.673281:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315456:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (11429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578923.673287:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:2.0:1789578923.673532:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:2.0:1789578923.673539:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261315072:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578923.673566:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261315072:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (11129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578923.673586:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00080000:2.0:1789578923.673631:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578923.673635:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789578923.682156:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578923.682233:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315328 00000100:00100000:1.0:1789578923.682233:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315584 00000100:00100000:2.0:1789578923.682242:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315328 00000100:00100000:1.0:1789578923.682242:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315584 00000100:00100000:1.0:1789578923.682297:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789578923.682313:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:1.0:1789578923.682314:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315584:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578923.682320:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315328:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578923.682407:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315584:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578923.682415:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00080000:0.0:1789578923.685080:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578923.685090:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578923.688020:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261315328:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 5687us (20191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578923.688035:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 140 00010000:00010000:0.0:1789578924.139879:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578924.389588:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277115776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578924.389653:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578924.389728:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115776 00000100:00100000:1.0:1789578924.389736:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115776 00000100:00100000:1.0:1789578924.389787:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578924.389796:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277115776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578924.389823:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578924.389864:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277115776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578924.389870:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789578924.389889:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789578924.389917:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350f800 x1876509277115776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578924.389935:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277115776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578924.393185:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277115904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578924.393246:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578924.393986:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789578924.393995:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277116032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578924.394025:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.394363:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277115904 00000100:00100000:3.0:1789578924.394371:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277115904 00000100:00100000:3.0:1789578924.394545:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116032 00000100:00100000:3.0:1789578924.394549:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116032 00000100:00100000:3.0:1789578924.394572:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789578924.394580:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277115904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789578924.394608:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578924.394656:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277115904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.394662:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789578924.394677:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789578924.394683:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277116032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789578924.394694:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578924.394717:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277116032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.394723:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1789578924.394918:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a82680 x1876509277116032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789578924.394937:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578924.394939:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277116032:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789578924.394941:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789578924.394954:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bed80 x1876509277115904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578924.394966:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277115904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578924.396520:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277116160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578924.396576:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396617:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277116672:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396639:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396657:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277117184:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396674:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396695:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789578924.396701:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277116288:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396724:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396743:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277116800:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396778:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396796:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277117312:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396817:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.396842:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116672 00000100:00100000:3.0:1789578924.396848:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116672 00000100:00100000:3.0:1789578924.396881:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117184 00000100:00100000:3.0:1789578924.396884:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117184 00000100:00100000:3.0:1789578924.396902:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117312 00000100:00100000:3.0:1789578924.396905:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117312 00000100:00100000:3.0:1789578924.396921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789578924.396929:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277116672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.396973:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277116672:12345-0@lo:400:kworker.0 Request processed in 45us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.396980:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789578924.396993:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789578924.396999:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277117184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397023:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277117184:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.397034:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789578924.397045:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789578924.397050:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277117312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397073:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277117312:12345-0@lo:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.397079:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789578924.397096:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116288 00000100:00100000:3.0:1789578924.397099:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116288 00000100:00100000:3.0:1789578924.397121:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789578924.397126:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277116288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397153:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277116288:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.397158:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789578924.397181:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116800 00000100:00100000:3.0:1789578924.397185:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116800 00000100:00100000:3.0:1789578924.397207:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789578924.397213:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277116800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397239:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277116800:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.397244:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789578924.397269:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277116544:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397289:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.397315:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277117056:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397332:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.397346:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789578924.397375:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277116416:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.397397:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578924.397491:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116160 00000100:00100000:0.0:1789578924.397496:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116160 00000100:00100000:0.0:1789578924.397533:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789578924.397540:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277116160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578924.397554:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578924.397586:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277116160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578924.397601:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789578924.398513:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277116928:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.398545:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.398570:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277117440:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.398590:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578924.398621:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116544 00000100:00100000:3.0:1789578924.398626:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116544 00000100:00100000:3.0:1789578924.398653:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789578924.398660:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277116544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.398697:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277116544:12345-0@lo:400:kworker.0 Request processed in 37us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.398704:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789578924.398721:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117440 00000100:00100000:3.0:1789578924.398725:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117440 00000100:00100000:3.0:1789578924.398746:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789578924.398752:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277117440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.398908:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277117440:12345-0@lo:400:kworker.0 Request processed in 155us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.398915:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789578924.398936:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117056 00000100:00100000:3.0:1789578924.398940:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117056 00000100:00100000:3.0:1789578924.398964:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116416 00000100:00100000:3.0:1789578924.398967:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116416 00000100:00100000:3.0:1789578924.398977:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277116928 00000100:00100000:3.0:1789578924.398980:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277116928 00000100:00100000:3.0:1789578924.398993:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789578924.398999:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277117056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399033:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277117056:12345-0@lo:400:kworker.0 Request processed in 34us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.399040:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789578924.399051:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789578924.399057:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277116416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399083:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277116416:12345-0@lo:400:kworker.0 Request processed in 26us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.399088:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789578924.399098:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789578924.399103:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277116928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399128:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277116928:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578924.399133:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1789578924.399150:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578924.399154:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578924.399157:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578924.399190:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277116416:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399200:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277116928:0@lo:400:kworker.0 00010000:00080000:3.0:1789578924.399211:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ebb80 x1876509277117440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578924.399221:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277117440:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399230:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277116544:0@lo:400:kworker.0 00010000:00080000:3.0:1789578924.399240:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd5180 x1876509277117056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578924.399259:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277117056:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399294:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277116288:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399317:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277116800:0@lo:400:kworker.0 00010000:00080000:3.0:1789578924.399328:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9c00 x1876509277117312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578924.399336:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277117312:0@lo:400:kworker.0 00010000:00080000:3.0:1789578924.399345:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd5f80 x1876509277116160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578924.399379:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277116160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578924.399391:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277116672:0@lo:400:kworker.0 00000100:00100000:3.0:1789578924.399402:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277117184:0@lo:400:kworker.0 00010000:00010000:0.0:1789578925.155495:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578925.418254:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277117568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578925.418340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578925.418443:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117568 00000100:00100000:3.0:1789578925.418645:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117568 00000100:00100000:3.0:1789578925.418686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789578925.418694:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277117568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578925.418723:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578925.418761:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277117568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578925.418768:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789578925.418835:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277117568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578925.421014:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578925.421034:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277117696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578925.421092:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578925.421736:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117696 00000100:00100000:3.0:1789578925.421746:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117696 00000100:00100000:3.0:1789578925.421791:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789578925.421800:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277117696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578925.421833:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578925.421882:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277117696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578925.421889:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789578925.422884:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277117696:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789578926.179564:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789578927.012855:0:12477:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578927.013175:0:12477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789578927.213073:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578928.227515:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578928.770636:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.770689:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.770723:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.770753:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.770805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315968 00000100:00100000:3.0:1789578928.770822:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315968 00000100:00100000:1.0:1789578928.770831:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261315840 00000100:00100000:1.0:1789578928.770850:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261315840 00000100:00100000:3.0:1789578928.770915:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316224 00000100:00100000:3.0:1789578928.770921:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316224 00000100:00100000:1.0:1789578928.770944:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 307 00000100:00100000:1.0:1789578928.770958:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261315840:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578928.770968:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:3.0:1789578928.770981:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261315968:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578928.771046:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261315840:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578928.771049:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261315968:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578928.771063:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:1.0:1789578928.771080:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 307 00000100:00100000:3.0:1789578928.771087:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:3.0:1789578928.771098:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261316224:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578928.771139:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261316224:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 44us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578928.771173:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:3.0:1789578928.771212:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316480 00000100:00100000:3.0:1789578928.771217:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316480 00000100:00100000:3.0:1789578928.771256:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:3.0:1789578928.771277:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261316480:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578928.771316:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261316480:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 53us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578928.771324:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00080000:3.0:1789578928.771392:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789578928.771405:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578928.779771:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.779830:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578928.779873:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578928.780455:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316608 00000100:00100000:2.0:1789578928.780471:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316608 00000100:00100000:2.0:1789578928.780554:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:2.0:1789578928.780565:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261316608:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578928.780652:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261316608:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 88us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578928.780659:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789578928.780962:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316096 00000100:00100000:0.0:1789578928.780968:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316096 00000100:00100000:0.0:1789578928.781006:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316352 00000100:00100000:0.0:1789578928.781009:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316352 00000100:00100000:0.0:1789578928.781028:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:0.0:1789578928.781034:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261316096:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578928.781069:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261316096:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 35us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578928.781076:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:0.0:1789578928.781090:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:0.0:1789578928.781096:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261316352:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578928.781119:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261316352:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578928.781124:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00080000:3.0:1789578928.781568:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578928.781580:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789578929.253138:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789578929.486724:0:12575:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789578929.487207:0:12575:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789578929.508530:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277117824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578929.508730:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.508927:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117824 00000100:00100000:2.0:1789578929.508934:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117824 00000100:00100000:2.0:1789578929.508982:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789578929.508991:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943b4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277117824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578929.509020:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578929.509063:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943b4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277117824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.509070:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789578929.509256:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bc380 x1876509277117824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.509287:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277117824:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789578929.509324:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789578929.509447:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789578929.509457:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277117952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578929.509487:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.509518:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277117952 00000100:00100000:3.0:1789578929.509523:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277117952 00000100:00100000:3.0:1789578929.509550:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789578929.509556:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277117952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789578929.510707:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578929.510763:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277117952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1205us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.510780:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789578929.510986:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277118080:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511022:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.511055:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277118592:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511079:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.511096:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277119104:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511116:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789578929.511144:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd5180 x1876509277117952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578929.511163:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277117952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578929.511179:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789578929.511185:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277118464:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511207:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.511228:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277118976:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511247:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.511284:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118080 00000100:00100000:3.0:1789578929.511290:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118080 00000100:00100000:3.0:1789578929.511324:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789578929.511331:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277118080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511387:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277118080:12345-0@lo:400:kworker.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.511394:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789578929.511418:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118592 00000100:00100000:3.0:1789578929.511422:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118592 00000100:00100000:3.0:1789578929.511452:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789578929.511459:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277118592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.511490:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277118592:12345-0@lo:400:kworker.0 Request processed in 32us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.511496:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789578929.511514:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119104 00000100:00100000:3.0:1789578929.511517:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119104 00000100:00100000:3.0:1789578929.511542:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118976 00000100:00100000:3.0:1789578929.511545:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118976 00000100:00100000:3.0:1789578929.511577:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789578929.511584:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277119104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.511951:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277118208:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.511984:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512006:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277118720:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512024:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512039:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277119232:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512056:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512077:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789578929.512083:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277118336:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512102:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512117:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277118848:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512134:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512143:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277119360:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512158:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578929.512188:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118464 00000100:00100000:2.0:1789578929.512192:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118464 00000100:00100000:2.0:1789578929.512214:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118208 00000100:00100000:2.0:1789578929.512217:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118208 00000100:00100000:2.0:1789578929.512228:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118720 00000100:00100000:2.0:1789578929.512230:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118720 00000100:00100000:2.0:1789578929.512241:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119232 00000100:00100000:2.0:1789578929.512243:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119232 00000100:00100000:2.0:1789578929.512253:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118848 00000100:00100000:2.0:1789578929.512255:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118848 00000100:00100000:2.0:1789578929.512280:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119360 00000100:00100000:2.0:1789578929.512283:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119360 00000100:00100000:2.0:1789578929.512301:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789578929.512307:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277118464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512339:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277118464:12345-0@lo:400:kworker.0 Request processed in 32us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.512345:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789578929.512375:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789578929.512381:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277118208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512408:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277118208:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.512414:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789578929.512424:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789578929.512430:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512453:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277118720:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.512459:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789578929.512468:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789578929.512473:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277119232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512501:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277119232:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.512507:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789578929.512517:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789578929.512523:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277118848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.512545:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277118848:12345-0@lo:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.512550:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789578929.512575:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789578929.512582:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277119360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578929.516977:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789578929.516995:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277118976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.517111:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277119104:12345-0@lo:400:kworker.0 Request processed in 5526us (5992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.517121:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789578929.517159:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277119616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578929.517207:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.517253:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277118464:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.517281:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277118080:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.517292:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277118592:0@lo:400:kworker.0 00010000:00080000:3.0:1789578929.517304:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5eaa00 x1876509277119104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578929.517315:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277119104:0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.517338:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789578929.517345:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277119488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578929.517389:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578929.517439:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277118336 00000100:00100000:3.0:1789578929.517446:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277118336 00000100:00100000:3.0:1789578929.517478:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578929.517484:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277118336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578929.517518:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277118336:12345-0@lo:400:kworker.0 Request processed in 34us (5415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.517523:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578929.517539:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119616 00000100:00100000:3.0:1789578929.517543:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119616 00000100:00100000:3.0:1789578929.517557:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119488 00000100:00100000:3.0:1789578929.517570:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119488 00000100:00100000:3.0:1789578929.517585:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789578929.517592:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277119616:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578929.518839:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277119360:12345-0@lo:400:kworker.0 Request processed in 6252us (6674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578929.518850:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789578929.518908:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277118336:0@lo:400:kworker.0 00010000:00080000:2.0:1789578929.518923:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9880 x1876509277118848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.518933:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277118848:0@lo:400:kworker.0 00010000:00080000:2.0:1789578929.518944:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8700 x1876509277119360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.518952:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277119360:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.518963:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277118208:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.518973:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277118720:0@lo:400:kworker.0 00000100:00100000:2.0:1789578929.518995:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277119232:0@lo:400:kworker.0 00002000:00000024:3.0:1789578929.519710:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578929.519781:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277119616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2189us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.519895:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789578929.519918:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789578929.519928:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277119488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789578929.519948:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578929.519973:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277119488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578929.519979:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1789578929.520745:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a80380 x1876509277119488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.520765:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277119488:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789578929.520788:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a81c00 x1876509277119616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.520813:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277119616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578929.523712:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277118976:12345-0@lo:400:kworker.0 Request processed in 6715us (12454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578929.523726:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789578929.523783:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578929.523804:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578929.523808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789578929.523811:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789578929.526552:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8380 x1876509277118976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578929.526582:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277118976:0@lo:400:kworker.0 00010000:00010000:1.0:1789578930.275913:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578930.531527:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578930.531551:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277119744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578930.531619:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578930.531721:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119744 00000100:00100000:3.0:1789578930.531729:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119744 00000100:00100000:3.0:1789578930.531782:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789578930.531792:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277119744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578930.531838:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578930.531893:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277119744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578930.531900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789578930.531979:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277119744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578930.537228:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277119872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578930.537319:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578930.542159:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277119872 00000100:00100000:3.0:1789578930.542175:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277119872 00000100:00100000:3.0:1789578930.542279:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789578930.542289:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277119872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578930.542484:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578930.542552:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277119872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 264us (5236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578930.542559:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789578930.542633:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277119872:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1789578931.230680:0:12673:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789578931.230880:0:12673:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789578931.300430:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578932.325274:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578933.379008:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789578933.754195:0:12770:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789578933.754522:0:12770:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789578933.888419:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888457:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888481:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888500:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888515:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888532:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888605:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578933.888634:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316864 00000100:00100000:1.0:1789578933.888643:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316864 00000100:00100000:1.0:1789578933.888695:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317120 00000100:00100000:1.0:1789578933.888698:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317120 00000100:00100000:1.0:1789578933.888710:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316992 00000100:00100000:1.0:1789578933.888719:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316992 00000100:00100000:1.0:1789578933.888731:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317248 00000100:00100000:1.0:1789578933.888733:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317248 00000100:00100000:1.0:1789578933.888747:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 157 00000100:00100000:1.0:1789578933.888755:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261316864:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578933.888832:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261316864:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578933.888839:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 157 00000100:00100000:1.0:1789578933.888855:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:1.0:1789578933.888860:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261317120:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578933.888882:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261317120:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578933.888889:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:1.0:1789578933.888900:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:1.0:1789578933.888906:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261316992:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578933.888927:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261316992:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578933.888933:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:1.0:1789578933.888943:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:1.0:1789578933.888949:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261317248:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578933.888968:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261317248:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 19us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578933.888974:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00080000:1.0:1789578933.888991:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578933.888995:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578933.889524:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261316736 00000100:00100000:3.0:1789578933.889531:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261316736 00000100:00100000:3.0:1789578933.889579:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 309 00000100:00100000:3.0:1789578933.889587:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261316736:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578933.889625:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261316736:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 39us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578933.889632:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 309 00000100:00100000:3.0:1789578933.889664:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317376 00000100:00100000:3.0:1789578933.889667:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317376 00000100:00100000:3.0:1789578933.889709:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317504 00000100:00100000:3.0:1789578933.889712:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317504 00000100:00100000:3.0:1789578933.889733:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789578933.889740:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2391:x1876509261317376:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:3.0:1789578933.889780:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20e08 00000100:00080000:3.0:1789578933.889790:0:8403:0:(import.c:65:import_set_state_nolock()) ffff939304090800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789578933.889832:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789578933.889947:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+2:2391:x1876509261317376:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 206us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578933.889954:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789578933.889966:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789578933.889972:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2391:x1876509261317504:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:3.0:1789578933.889984:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20e0f 00000100:00080000:3.0:1789578933.889989:0:8403:0:(import.c:65:import_set_state_nolock()) ffff93943f645800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789578933.890011:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789578933.890076:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+2:2391:x1876509261317504:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 103us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578933.890083:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00010000:00010000:3.0:1789578933.890185:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578933.890191:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789578933.890196:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789578933.890199:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789578934.435833:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578934.627589:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277120128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578934.627655:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578934.627675:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277120256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578934.627711:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578934.627784:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277120000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578934.627998:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578934.628005:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277120384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578934.628030:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578934.628064:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120128 00000100:00100000:3.0:1789578934.628071:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120128 00000100:00100000:3.0:1789578934.628110:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120256 00000100:00100000:3.0:1789578934.628113:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120256 00000100:00100000:3.0:1789578934.628137:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120384 00000100:00100000:3.0:1789578934.628139:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120384 00000100:00100000:3.0:1789578934.628153:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789578934.628161:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277120128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789578934.628188:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578934.628509:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.628618:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120000 00000100:00100000:2.0:1789578934.628623:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120000 00000100:00100000:2.0:1789578934.628644:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789578934.628650:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277120256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578934.628666:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578934.628700:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277120256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.628706:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789578934.628720:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789578934.628725:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277120384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789578934.628733:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578934.628768:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277120384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.628780:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789578934.628791:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789578934.628796:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277120000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578934.628806:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789578934.628935:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd4a80 x1876509277120384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578934.628951:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277120384:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789578934.628961:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd5500 x1876509277120256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578934.628970:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277120256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578934.629112:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277120000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 314us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.629119:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789578934.629149:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b30a80 x1876509277120000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578934.629163:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277120000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578934.629399:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277120512:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629428:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.629452:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277121024:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629475:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.629492:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277121536:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629515:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.629533:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789578934.629539:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277120640:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629559:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.629575:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277121152:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.629614:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121024 00000100:00100000:2.0:1789578934.629618:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121024 00000100:00100000:2.0:1789578934.629644:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789578934.629658:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277121024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.629692:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277121024:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.629697:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789578934.629715:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121536 00000100:00100000:2.0:1789578934.629718:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121536 00000100:00100000:2.0:1789578934.629739:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120640 00000100:00100000:2.0:1789578934.629741:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120640 00000100:00100000:2.0:1789578934.629946:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121152 00000100:00100000:2.0:1789578934.629950:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121152 00000100:00100000:2.0:1789578934.629964:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789578934.629970:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277121536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630002:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277121536:12345-0@lo:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630007:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789578934.630016:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789578934.630021:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277120640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630040:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277120640:12345-0@lo:400:kworker.0 Request processed in 19us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630045:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789578934.630054:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789578934.630058:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277121152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630079:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277121152:12345-0@lo:400:kworker.0 Request processed in 21us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630084:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789578934.630107:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277120768:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630137:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.630201:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277121280:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630220:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.630255:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789578934.630261:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277120896:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630282:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.630296:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277121408:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630316:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578934.630333:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121280 00000100:00100000:2.0:1789578934.630338:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121280 00000100:00100000:2.0:1789578934.630375:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120896 00000100:00100000:2.0:1789578934.630377:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120896 00000100:00100000:2.0:1789578934.630389:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121408 00000100:00100000:2.0:1789578934.630391:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121408 00000100:00100000:2.0:1789578934.630403:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789578934.630408:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277121280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630441:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277121280:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630446:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789578934.630458:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789578934.630463:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630486:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277120896:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630491:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789578934.630500:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789578934.630505:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277121408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630539:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277121408:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578934.630544:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789578934.630577:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277120640:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630588:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277121152:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630598:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277121024:0@lo:400:kworker.0 00010000:00080000:2.0:1789578934.630608:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5180 x1876509277121536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578934.630618:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277121536:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630643:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277120896:0@lo:400:kworker.0 00000100:00100000:2.0:1789578934.630650:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277121408:0@lo:400:kworker.0 00010000:00080000:2.0:1789578934.630657:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5c00 x1876509277121280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578934.630664:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277121280:0@lo:400:kworker.0 00000100:00080000:2.0:1789578934.630692:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578934.630695:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578934.630698:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578934.630700:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578934.630776:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277120128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2614us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578934.630783:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789578934.633070:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120768 00000100:00100000:0.0:1789578934.633082:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120768 00000100:00100000:0.0:1789578934.633123:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789578934.633132:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277120768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578934.633263:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277120768:12345-0@lo:400:kworker.0 Request processed in 131us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578934.633270:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789578934.634512:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277120512 00000100:00100000:0.0:1789578934.634523:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277120512 00000100:00100000:0.0:1789578934.634575:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789578934.634583:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277120512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578934.634643:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277120512:12345-0@lo:400:kworker.0 Request processed in 60us (5213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578934.634649:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789578934.634743:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277120512:0@lo:400:kworker.0 00000100:00100000:3.0:1789578934.634999:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277120768:0@lo:400:kworker.0 00010000:00080000:1.0:1789578934.637858:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a83800 x1876509277120128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578934.637888:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277120128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789578935.465995:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578935.654316:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277121664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578935.654408:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578935.654860:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121664 00000100:00100000:2.0:1789578935.654867:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121664 00000100:00100000:2.0:1789578935.654909:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789578935.654917:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277121664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789578935.654953:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789578935.654998:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277121664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578935.655004:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789578935.655021:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578935.655041:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277121792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578935.655066:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578935.655089:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121792 00000100:00100000:2.0:1789578935.655093:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121792 00000100:00100000:2.0:1789578935.655112:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789578935.655117:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277121792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789578935.655133:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578935.655164:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277121792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578935.655170:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789578935.655208:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277121792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578935.655335:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277121664:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789578935.738073:0:12868:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789578935.738672:0:12868:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789578936.495317:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578937.512564:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578938.533389:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578939.002034:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578939.002086:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578939.002120:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578939.002141:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578939.002179:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578939.002221:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317888 00000100:00100000:3.0:1789578939.002234:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317888 00000100:00100000:3.0:1789578939.002299:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318144 00000100:00100000:3.0:1789578939.002302:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318144 00000100:00100000:3.0:1789578939.002317:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317760 00000100:00100000:3.0:1789578939.002319:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317760 00000100:00100000:3.0:1789578939.002332:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318016 00000100:00100000:3.0:1789578939.002335:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318016 00000100:00100000:3.0:1789578939.002392:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:3.0:1789578939.002405:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261317888:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578939.002517:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261317888:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.002526:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:3.0:1789578939.002546:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:3.0:1789578939.002553:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2393:x1876509261318144:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578939.002582:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2393:x1876509261318144:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.002589:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:3.0:1789578939.002600:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 169 00000100:00100000:3.0:1789578939.002607:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261317760:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578939.002842:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261317760:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 233us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.002850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 169 00000100:00100000:3.0:1789578939.002864:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:3.0:1789578939.002871:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2393:x1876509261318016:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578939.002899:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2393:x1876509261318016:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.002905:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00080000:3.0:1789578939.002930:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578939.002935:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789578939.003753:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261317632 00000100:00100000:1.0:1789578939.003761:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261317632 00000100:00100000:1.0:1789578939.003808:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 311 00000100:00100000:1.0:1789578939.003817:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261317632:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578939.003857:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261317632:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 40us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578939.003864:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 311 00010000:00010000:1.0:1789578939.555714:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578939.747617:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578939.747639:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578939.747704:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.752367:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277121920 00000100:00100000:2.0:1789578939.752376:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277121920 00000100:00100000:2.0:1789578939.752439:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789578939.752450:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277121920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578939.752478:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578939.752552:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277121920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.752569:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789578939.752601:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277122048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578939.752638:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.752677:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789578939.752681:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122048 00000100:00100000:2.0:1789578939.752685:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277122176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578939.752689:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122048 00000100:00100000:2.0:1789578939.752714:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578939.752719:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122176 00000100:00100000:3.0:1789578939.752723:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122176 00000100:00100000:3.0:1789578939.752745:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789578939.752760:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277122048:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789578939.752775:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789578939.752779:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578939.752794:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00002000:00000024:3.0:1789578939.752805:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578939.752805:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277122176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789578939.752825:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578939.752856:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277122048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.752862:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277122176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.752868:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789578939.752876:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789578939.752907:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277122304:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789578939.752913:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a4a300 x1876509277122176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578939.752936:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277122176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578939.752937:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789578939.752956:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a83800 x1876509277122048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578939.752968:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277122048:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789578939.752973:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ea680 x1876509277121920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578939.752990:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578939.753012:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122304 00000100:00100000:3.0:1789578939.753017:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122304 00000100:00080000:2.0:1789578939.753047:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578939.753057:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789578939.753065:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277122304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578939.753107:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578939.753145:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277122304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.753152:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789578939.753401:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277122816:0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753432:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578939.753456:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277123328:0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753475:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789578939.753569:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e4700 x1876509277122304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578939.753584:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277122304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578939.753597:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789578939.753603:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277122432:0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753640:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578939.753663:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277122944:0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753686:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578939.753703:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277123456:0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753722:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578939.753749:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122816 00000100:00100000:3.0:1789578939.753753:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122816 00000100:00100000:3.0:1789578939.753778:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123328 00000100:00100000:3.0:1789578939.753781:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123328 00000100:00100000:3.0:1789578939.753800:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123456 00000100:00100000:3.0:1789578939.753802:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123456 00000100:00100000:3.0:1789578939.753815:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789578939.753821:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277122816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753858:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277122816:12345-0@lo:400:kworker.0 Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.753864:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789578939.753876:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789578939.753882:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277123328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753907:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277123328:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.753913:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789578939.753923:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789578939.753929:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277123456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.753955:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277123456:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.753961:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789578939.754337:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122432 00000100:00100000:3.0:1789578939.754342:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122432 00000100:00100000:3.0:1789578939.754401:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789578939.754407:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277122432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578939.754437:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277122432:12345-0@lo:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578939.754442:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789578939.754465:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122944 00000100:00100000:3.0:1789578939.754468:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122944 00000100:00100000:3.0:1789578939.754488:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789578939.754492:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277122944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754601:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277122688:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754636:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.754656:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277123200:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754674:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.754691:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789578939.754696:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277122560:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.754729:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277123072:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754746:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578939.754763:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122688 00000100:00100000:2.0:1789578939.754767:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122688 00000100:00100000:2.0:1789578939.754784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789578939.754789:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277122688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754820:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277122688:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.754825:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789578939.754839:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123200 00000100:00100000:2.0:1789578939.754842:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123200 00000100:00100000:2.0:1789578939.754858:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277122560 00000100:00100000:2.0:1789578939.754860:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277122560 00000100:00100000:2.0:1789578939.754869:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123072 00000100:00100000:2.0:1789578939.754871:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123072 00000100:00100000:2.0:1789578939.754884:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789578939.754889:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277123200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754916:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277123200:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.754922:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789578939.754937:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789578939.754949:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277122560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.754976:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277122560:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.754982:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789578939.755008:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789578939.755015:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277123072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.755043:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277123072:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.755049:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789578939.755082:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277122560:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.755092:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277123072:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.755099:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277122688:0@lo:400:kworker.0 00010000:00080000:2.0:1789578939.755108:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93942a0d2a00 x1876509277123200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578939.755116:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277123200:0@lo:400:kworker.0 00000100:00080000:2.0:1789578939.755157:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578939.755161:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578939.755182:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277122432:0@lo:400:kworker.0 00010000:00080000:2.0:1789578939.755209:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93942a0d1500 x1876509277123456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578939.755218:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277123456:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.755226:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277122816:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.755249:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277123328:0@lo:400:kworker.0 00000100:00100000:2.0:1789578939.757271:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277122944:12345-0@lo:400:kworker.0 Request processed in 2769us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578939.757284:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789578939.757722:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277122944:0@lo:400:kworker.0 00000001:00100000:3.0:1789578939.759628:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000020:00000080:3.0:1789578939.759635:0:9483:0:(genops.c:885:class_export_put()) final put ffff93943f642000/eb97d94f-5343-4111-9eea-cc9a295afa74 00000020:00000080:1.0:1789578939.760588:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f642000/eb97d94f-5343-4111-9eea-cc9a295afa74 for lustre-OST0001 00000020:00000080:1.0:1789578939.760644:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f645800 for lustre-OST0001 00000001:00100000:2.0:1789578939.762605:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000020:00000080:2.0:1789578939.762614:0:8398:0:(genops.c:885:class_export_put()) final put ffff939304092000/eb97d94f-5343-4111-9eea-cc9a295afa74 00000020:00000080:3.0:1789578939.764303:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939304092000/eb97d94f-5343-4111-9eea-cc9a295afa74 for lustre-OST0000 00000020:00000080:3.0:1789578939.764380:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939304090800 for lustre-OST0000 00000001:02000400:1.0:1789578939.891145:0:13012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789578940.579940:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578940.775764:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277123584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578940.775836:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578940.775918:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123584 00000100:00100000:3.0:1789578940.775926:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123584 00000100:00100000:3.0:1789578940.775968:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789578940.775978:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277123584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789578940.776015:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578940.776060:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277123584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578940.776077:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789578940.776123:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277123584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578940.776413:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578940.776421:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277123712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578940.776447:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578940.776476:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123712 00000100:00100000:1.0:1789578940.776479:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123712 00000100:00100000:1.0:1789578940.776500:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789578940.776506:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277123712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578940.776521:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578940.776549:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277123712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578940.776561:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789578940.776587:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277123712:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789578941.605523:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578942.628574:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789578943.072857:0:13160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe549dd5f0 20000000:00000080:2.0:1789578943.072875:0:13160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939302b48400 uarg=0000000000000000 20000000:01000000:2.0:1789578943.072922:0:13160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789578943.072928:0:13160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789578943.072933:0:13160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789578943.073327:0:13161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789578943.073700:0:13160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789578943.081977:0:13160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789578943.082006:0:13160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082026:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082036:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dad expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082042:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082049:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082077:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082085:0:13160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082094:0:13160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082135:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082151:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 12 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082173:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277123840:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578943.082274:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082283:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082293:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277123968:0@lo:104: 00000100:00100000:2.0:1789578943.082332:0:13160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578943.082396:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082404:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 23 pid: 6485 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082419:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124096:0@lo:104: 00000100:00100000:2.0:1789578943.082443:0:13160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578943.082475:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082484:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082492:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124224:0@lo:104: 00000100:00100000:2.0:1789578943.082510:0:13160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578943.082531:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082538:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082545:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124352:0@lo:104: 00000100:00100000:2.0:1789578943.082562:0:13160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789578943.082579:0:13160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.082588:0:13160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.082596:0:13160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124480:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578943.082615:0:13160:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578943.084700:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277123968 00000100:00100000:0.0:1789578943.084713:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277123968 00000100:00100000:0.0:1789578943.084756:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124096 00000100:00100000:0.0:1789578943.084759:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124096 00000100:00100000:0.0:1789578943.084768:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124224 00000100:00100000:0.0:1789578943.084769:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124224 00000100:00100000:0.0:1789578943.084774:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124352 00000100:00100000:0.0:1789578943.084776:0:6473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124352 00000100:00100000:0.0:1789578943.084784:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789578943.084790:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+6:13160:x1876509277123968:12345-0@lo:104: 00010000:00010000:0.0:1789578943.084802:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.084881:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789578943.084886:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+6:13160:x1876509277123968:12345-0@lo:104: Request processed in 96us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.084892:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789578943.084898:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277123968:0@lo:104: 00000100:00100000:0.0:1789578943.084909:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789578943.084914:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+5:13160:x1876509277124096:12345-0@lo:104: 00010000:00010000:0.0:1789578943.084921:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.084960:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789578943.084965:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+5:13160:x1876509277124096:12345-0@lo:104: Request processed in 52us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.084971:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789578943.084982:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578943.084988:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:13160:x1876509277124224:12345-0@lo:104: 00010000:00010000:0.0:1789578943.085004:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085039:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789578943.085040:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124096:0@lo:104: 00000100:00100000:0.0:1789578943.085044:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+4:13160:x1876509277124224:12345-0@lo:104: Request processed in 57us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578943.085048:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124224:0@lo:104: 00000100:00100000:0.0:1789578943.085050:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789578943.085062:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578943.085068:0:6473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:13160:x1876509277124352:12345-0@lo:104: 00010000:00010000:0.0:1789578943.085076:0:6473:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085112:0:6473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789578943.085117:0:6473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+3:13160:x1876509277124352:12345-0@lo:104: Request processed in 50us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.085122:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789578943.085141:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789578943.085146:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085154:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789578943.085158:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085179:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578943.085187:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578943.085199:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789578943.085230:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085237:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578943.085257:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085264:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f20dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dde expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085278:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789578943.085282:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085287:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789578943.085290:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085297:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578943.085303:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578943.085308:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789578943.085321:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085327:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578943.085340:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085346:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437a00/0xd90373d592f20dc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dd0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085376:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789578943.085380:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085386:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789578943.085388:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085395:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578943.085401:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578943.085406:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789578943.085418:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085425:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578943.085439:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085446:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303a37600/0xd90373d592f20dbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20dc2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085454:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578943.085526:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085532:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc125cc20) 00000100:00100000:2.0:1789578943.085534:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124352:0@lo:104: 10000000:00010000:0.0:1789578943.085535:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085542:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789578943.085549:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789578943.085554:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789578943.085576:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085582:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789578943.085589:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085595:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303a36c00/0xd90373d592f20dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20db4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085609:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578943.085610:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578943.085612:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578943.085619:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578943.085624:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578943.085636:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277124736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.085669:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578943.085710:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578943.085717:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277124608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.085738:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578943.085762:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277124864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.085782:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578943.085798:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789578943.085802:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277124992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.085819:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578943.085847:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124736 00000100:00100000:0.0:1789578943.085851:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124736 00010000:00010000:0.0:1789578943.085871:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 24 pid: 6485 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578943.085886:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124608 00000100:00100000:0.0:1789578943.085888:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124608 00010000:00010000:0.0:1789578943.085897:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 25 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578943.085907:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124864 00000100:00100000:0.0:1789578943.085909:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124864 00010000:00010000:0.0:1789578943.085916:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 26 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578943.085924:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277124992 00000100:00100000:0.0:1789578943.085926:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277124992 00010000:00010000:0.0:1789578943.085933:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 27 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578943.085943:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578943.085948:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+27:3616:x1876509277124736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789578943.085968:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578943.085973:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 27 pid: 6485 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085981:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 27 pid: 6485 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.085994:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36600/0xd90373d592f20dd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20dc9 expref: 27 pid: 6485 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086005:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578943.086032:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+26:3616:x1876509277124736:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.086038:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789578943.086052:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578943.086058:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3616:x1876509277124608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789578943.086064:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578943.086068:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 25 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086076:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 25 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086084:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36800/0xd90373d592f20dde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20dd7 expref: 25 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086092:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578943.086109:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277124608:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.086123:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789578943.086133:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789578943.086139:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3617:x1876509277124864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789578943.086145:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578943.086150:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086157:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086177:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae200/0xd90373d592f20dc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20dbb expref: 23 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086185:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578943.086213:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3617:x1876509277124864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.086219:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789578943.086229:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578943.086234:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3617:x1876509277124992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789578943.086241:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578943.086245:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 21 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086252:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 21 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086260:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436c00/0xd90373d592f20db4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20dad expref: 21 pid: 6484 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578943.086277:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578943.086299:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3617:x1876509277124992:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578943.086305:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789578943.086336:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277124992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.086343:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277124864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.086384:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277124608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789578943.086391:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277124736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789578943.087064:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578943.091851:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277123840:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578943.091866:0:13160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13160:1876509277124480:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578943.091902:0:13160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578943.092708:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578943.092790:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578943.093617:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318272 00000100:00100000:2.0:1789578943.093627:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318272 00010000:00010000:2.0:1789578943.093662:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 13 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.093701:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318400 00000100:00100000:2.0:1789578943.093704:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318400 00010000:00010000:2.0:1789578943.093725:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 14 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578943.093746:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789578943.093754:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d510876f-b8d4-4b66-af39-9463dcf1db3f+14:2395:x1876509261318272:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578943.093769:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578943.093774:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 14 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.093785:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 14 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.093801:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2ec00/0xd90373d592f20df3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe42 expref: 14 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578943.093919:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:3.0:1789578943.093928:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943214c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261318400:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578943.093936:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578943.093940:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 13 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.093961:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578943.094009:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261318272:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 255us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578943.094016:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00010000:00010000:3.0:1789578943.094217:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094229:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e600/0xd90373d592f20da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe03 expref: 12 pid: 6482 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094241:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094250:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094266:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094273:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094291:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094298:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094304:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789578943.094308:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094317:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.094639:0:13160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578943.094648:0:13160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094793:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094803:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af800/0xd90373d592f20e16 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578943.094819:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578943.095455:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943214c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2395:x1876509261318400:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1524us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578943.095529:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00010000:00010000:2.0:1789578943.651544:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578944.118427:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578944.118470:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578944.118493:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318528 00000100:00100000:1.0:1789578944.118502:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318528 00000100:00100000:3.0:1789578944.118507:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578944.118538:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578944.118552:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 313 00000100:00100000:1.0:1789578944.118561:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2395:x1876509261318528:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578944.118564:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578944.118587:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318784 00000100:00100000:3.0:1789578944.118602:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318784 00000100:00100000:1.0:1789578944.118626:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2395:x1876509261318528:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.118632:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319040 00000100:00100000:1.0:1789578944.118633:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 313 00000100:00100000:3.0:1789578944.118634:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319040 00000100:00100000:3.0:1789578944.118645:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318656 00000100:00100000:3.0:1789578944.118647:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318656 00000100:00100000:3.0:1789578944.118658:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261318912 00000100:00100000:3.0:1789578944.118660:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261318912 00000100:00100000:3.0:1789578944.118673:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:3.0:1789578944.118680:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261318784:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578944.118710:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261318784:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.118716:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:3.0:1789578944.118729:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:3.0:1789578944.118734:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261319040:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578944.118756:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261319040:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.118775:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:3.0:1789578944.118787:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:3.0:1789578944.118794:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261318656:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578944.118827:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261318656:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.118834:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:3.0:1789578944.118844:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:3.0:1789578944.118849:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261318912:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578944.118868:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261318912:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 19us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.118880:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00080000:3.0:1789578944.118900:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578944.118904:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578944.373405:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578944.373544:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319168 00000100:00100000:1.0:1789578944.373554:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319168 00000100:00100000:1.0:1789578944.373611:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 314 00000100:00100000:1.0:1789578944.373622:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:6165:x1876509261319168:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578944.373639:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578944.373656:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe73 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.373684:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.373708:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.373717:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:1.0:1789578944.373783:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319168:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 162us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.375000:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 314 00000100:00100000:1.0:1789578944.384597:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578944.384696:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319296 00000100:00100000:2.0:1789578944.384706:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319296 00000100:00100000:2.0:1789578944.384913:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 315 00000100:00100000:2.0:1789578944.384926:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319296:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.385097:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319296:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 174us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578944.385107:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 315 00000100:00100000:2.0:1789578944.397105:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578944.397172:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319424 00000100:00100000:1.0:1789578944.397182:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319424 00000100:00100000:1.0:1789578944.397238:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 316 00000100:00100000:1.0:1789578944.397249:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319424:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.397399:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319424:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 151us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.397406:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 316 00000100:00100000:1.0:1789578944.422857:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578944.422951:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319552 00000100:00100000:3.0:1789578944.422961:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319552 00000100:00100000:3.0:1789578944.423017:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 317 00000100:00100000:3.0:1789578944.423027:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261319552:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578944.423045:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578944.423062:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe7a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578944.423089:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578944.423101:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578944.423109:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37e00, rc 0) 00000100:00100000:3.0:1789578944.423171:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261319552:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 145us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.423177:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 317 00000100:00100000:3.0:1789578944.427265:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578944.427301:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319680 00000100:00100000:3.0:1789578944.427311:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319680 00000100:00100000:3.0:1789578944.427379:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 318 00000100:00100000:3.0:1789578944.427390:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261319680:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578944.428599:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261319680:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 1205us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.428618:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 318 00000100:00100000:0.0:1789578944.442811:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578944.443269:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319808 00000100:00100000:1.0:1789578944.443280:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319808 00000100:00100000:1.0:1789578944.445124:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 319 00000100:00100000:1.0:1789578944.445142:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261319808:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.445312:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261319808:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 176us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.445320:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 319 10000000:01000000:2.0:1789578944.675401:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578944.675409:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939302b3c800 from 7 10000000:01000000:2.0:1789578944.675413:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578944.675452:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.675464:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.675487:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.675522:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.675592:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.675639:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.675941:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125120 00000100:00100000:0.0:1789578944.675949:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125120 00000100:00100000:0.0:1789578944.676009:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789578944.676020:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277125120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578944.676034:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578944.676048:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20e2b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.676071:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20e2b expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.676082:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e2b expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.676091:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789578944.676128:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.676142:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1789578944.676214:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578944.676294:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578944.676308:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.676317:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.676407:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.676432:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.676457:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.676522:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125248 00000100:00100000:0.0:1789578944.676526:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125248 00000100:00100000:0.0:1789578944.676557:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789578944.676571:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578944.676675:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.676683:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789578944.677936:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.677982:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.678040:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.678069:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789578944.682898:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125376 00000100:00100000:3.0:1789578944.682911:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125376 00000100:00100000:3.0:1789578944.682970:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789578944.682981:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578944.683157:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.683165:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789578944.683971:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789578944.684948:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789578944.685079:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789578944.685103:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578944.685113:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.685136:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578944.685146:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578944.685159:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943711c800 from 7 10000000:01000000:2.0:1789578944.685161:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578944.685193:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.685201:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.685210:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.685233:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.685284:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.685326:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.685340:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125504 00000100:00100000:0.0:1789578944.685522:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125504 00000100:00100000:0.0:1789578944.685583:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789578944.685594:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277125504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578944.685608:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578944.685622:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20e39 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.685647:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20e39 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.685660:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e39 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.685669:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436800, rc 0) 00000100:00100000:0.0:1789578944.685724:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.685732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789578944.686241:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578944.686257:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578944.686266:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578944.686322:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578944.686375:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578944.686403:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394088e6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789578944.686462:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125632 00000100:00100000:2.0:1789578944.686467:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125632 00000100:00100000:2.0:1789578944.687075:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789578944.687085:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.687222:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578944.687230:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789578944.687321:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.687390:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93942a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.687430:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578944.687450:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393034600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578944.687513:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125760 00000100:00100000:3.0:1789578944.687518:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125760 00000100:00100000:3.0:1789578944.687538:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789578944.687544:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578944.687635:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578944.687641:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789578944.687707:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93942a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789578944.689226:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789578944.689429:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789578944.689457:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578944.689468:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.689486:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578944.689497:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578944.689500:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f42d800 from 7 10000000:01000000:2.0:1789578944.689503:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578944.689537:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.689554:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.689565:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.689588:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.689642:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.689686:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.689933:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277125888 00000100:00100000:0.0:1789578944.689940:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277125888 00000100:00100000:0.0:1789578944.689990:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789578944.690000:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277125888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578944.690011:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578944.690025:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20e47 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.690134:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20e47 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.690146:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e47 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578944.690168:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789578944.690214:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277125888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.690222:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789578944.690250:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277125888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578944.690270:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578944.690280:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578944.690347:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578944.690431:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578944.690468:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.690469:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126016 00000100:00100000:0.0:1789578944.690475:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126016 00000100:00100000:0.0:1789578944.692308:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789578944.692324:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277126016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578944.692951:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277126016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 631us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.692961:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789578944.693030:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.693080:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.693130:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.693199:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578944.693233:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126144 00000100:00100000:0.0:1789578944.693239:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126144 00000100:00100000:0.0:1789578944.693277:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789578944.693285:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277126144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578944.693885:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277126144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 599us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.693893:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789578944.694111:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789578944.695835:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789578944.696955:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789578944.696985:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578944.696997:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.697017:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578944.697040:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578944.697043:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940679b000 from 7 10000000:01000000:2.0:1789578944.697046:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578944.697271:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.697280:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.697292:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.697319:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.697409:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.697450:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578944.697553:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126272 00000100:00100000:1.0:1789578944.697571:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126272 00000100:00100000:1.0:1789578944.697616:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789578944.697625:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277126272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578944.697638:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578944.697651:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20e55 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.697675:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20e55 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.697910:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e55 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578944.697921:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518e00, rc 0) 00000100:00100000:1.0:1789578944.697970:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277126272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.697977:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789578944.698066:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578944.698204:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.698215:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578944.698275:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578944.698302:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.698344:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578944.698488:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126400 00000100:00100000:1.0:1789578944.698638:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126400 00000100:00100000:1.0:1789578944.698672:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789578944.698679:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277126400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.698859:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277126400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.698867:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789578944.698977:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578944.699005:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578944.699166:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.699192:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410355a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578944.699238:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126528 00000100:00100000:1.0:1789578944.699243:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126528 00000100:00100000:1.0:1789578944.699274:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789578944.699281:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277126528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578944.699467:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277126528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.699473:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789578944.700210:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277126528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789578944.701964:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789578944.702267:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789578944.702293:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578944.702304:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578944.702316:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578944.867904:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277126656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578944.867975:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868020:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277127168:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868045:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868064:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277127680:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868085:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868101:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277128192:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868119:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578944.868145:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127680 00000100:00100000:0.0:1789578944.868158:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789578944.868164:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127680 00000100:00100000:0.0:1789578944.868164:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277126784:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868187:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868205:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277127296:0@lo:400:kworker.0 00000100:00100000:1.0:1789578944.868211:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128192 00000100:00100000:1.0:1789578944.868213:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128192 00000100:00100000:0.0:1789578944.868222:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578944.868235:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578944.868237:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277127808:0@lo:400:kworker.0 00000100:00100000:1.0:1789578944.868243:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277127680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868253:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868293:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277126912:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868316:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868333:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277127424:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868373:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868390:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277127936:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868409:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868420:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789578944.868425:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277127040:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868445:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868469:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277127552:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868491:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868502:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277128064:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868520:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.868543:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126656 00000100:00100000:0.0:1789578944.868547:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126656 00000100:00100000:0.0:1789578944.868576:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789578944.868584:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277126656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789578944.868603:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578944.868635:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277126656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.868641:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789578944.868662:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127168 00000100:00100000:0.0:1789578944.868666:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127168 00000100:00100000:0.0:1789578944.868685:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126912 00000100:00100000:0.0:1789578944.868688:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126912 00000100:00100000:0.0:1789578944.868702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789578944.868707:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277127168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868747:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277127168:12345-0@lo:400:kworker.0 Request processed in 39us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.868754:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789578944.868766:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789578944.868771:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277126912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868799:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277126912:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.868805:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789578944.868820:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127552 00000100:00100000:0.0:1789578944.868823:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127552 00000100:00100000:0.0:1789578944.868838:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128064 00000100:00100000:0.0:1789578944.868840:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128064 00000100:00100000:0.0:1789578944.868852:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789578944.868858:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277128192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868886:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277128192:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.868892:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789578944.868903:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789578944.868909:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277127552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.868933:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277127552:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.868939:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789578944.868951:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789578944.868957:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277128064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578944.868965:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277127680:12345-0@lo:400:kworker.0 Request processed in 723us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578944.868972:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789578944.868977:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277128064:12345-0@lo:400:kworker.0 Request processed in 21us (457us total) trans 0 rc 0/0 00000100:00080000:1.0:1789578944.868987:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578944.868990:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789578944.868991:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578944.869004:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277126784 00000100:00100000:0.0:1789578944.869008:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277126784 00000100:00100000:0.0:1789578944.869025:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127296 00000100:00100000:0.0:1789578944.869027:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127296 00000100:00100000:0.0:1789578944.869044:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127808 00000100:00100000:0.0:1789578944.869046:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127808 00000100:00100000:0.0:1789578944.869058:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127424 00000100:00100000:0.0:1789578944.869060:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127424 00000100:00100000:0.0:1789578944.869071:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127936 00000100:00100000:0.0:1789578944.869073:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127936 00000100:00100000:0.0:1789578944.869082:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277127040 00000100:00100000:0.0:1789578944.869084:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277127040 00000100:00100000:0.0:1789578944.869095:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789578944.869100:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277126784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869133:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277126784:12345-0@lo:400:kworker.0 Request processed in 32us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869138:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789578944.869162:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789578944.869168:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277127296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869193:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277127296:12345-0@lo:400:kworker.0 Request processed in 26us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869198:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789578944.869208:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789578944.869213:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277127808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869232:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277127808:12345-0@lo:400:kworker.0 Request processed in 19us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869238:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789578944.869256:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789578944.869261:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277127424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869285:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277127424:12345-0@lo:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869291:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789578944.869302:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789578944.869307:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277127936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869333:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277127936:12345-0@lo:400:kworker.0 Request processed in 25us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869338:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789578944.869365:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789578944.869372:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277127040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869397:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277127040:12345-0@lo:400:kworker.0 Request processed in 26us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.869402:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789578944.869456:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277127040:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869469:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ebb80 x1876509277127552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869480:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277127552:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869490:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd4a80 x1876509277128064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869497:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277128064:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869506:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277126912:0@lo:400:kworker.0 00000100:00080000:1.0:1789578944.869522:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578944.869525:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789578944.869525:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9c00 x1876509277127424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869532:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277127424:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869541:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303bd5500 x1876509277127936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869548:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277127936:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869586:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277126784:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869594:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277127296:0@lo:400:kworker.0 00000100:00100000:0.0:1789578944.869601:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277127808:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869610:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ead80 x1876509277126656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869622:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277126656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578944.869632:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277127168:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869638:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9880 x1876509277127680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869644:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277127680:0@lo:400:kworker.0 00010000:00080000:0.0:1789578944.869652:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412ce00 x1876509277128192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578944.869659:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277128192:0@lo:400:kworker.0 00000100:00100000:2.0:1789578944.872509:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578944.872531:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277128448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578944.872595:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.872648:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128448 00000100:00100000:2.0:1789578944.872655:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128448 00000100:00100000:2.0:1789578944.872699:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789578944.872708:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277128448:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578944.872724:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277128320:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578944.872735:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578944.872753:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578944.872779:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277128448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578944.872786:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789578944.872800:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128320 00000100:00100000:2.0:1789578944.872803:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128320 00000100:00100000:2.0:1789578944.872818:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789578944.872823:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277128320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578944.872832:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578944.872868:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277128320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578944.872884:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1789578944.872921:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b32680 x1876509277128448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578944.872940:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277128448:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789578944.872944:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b31500 x1876509277128320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578944.872955:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277128320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578944.873272:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578944.873283:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277128576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578944.873310:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578944.873415:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128576 00000100:00100000:0.0:1789578944.873426:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128576 00000100:00100000:0.0:1789578944.873522:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789578944.873529:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277128576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578944.873541:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578944.873614:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277128576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578944.873620:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1789578944.875611:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412ce00 x1876509277128576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578944.875648:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277128576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789578945.704579:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578945.893397:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578945.893420:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277128704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578945.893491:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578945.893605:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128704 00000100:00100000:0.0:1789578945.893613:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128704 00000100:00100000:0.0:1789578945.893665:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578945.893675:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277128704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578945.893705:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789578945.893753:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277128704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578945.893760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578945.893805:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277128704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578945.894411:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789578945.894423:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277128832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578945.894456:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578945.894548:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128832 00000100:00100000:3.0:1789578945.894553:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128832 00000100:00100000:3.0:1789578945.894589:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789578945.894596:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277128832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578945.894614:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578945.894652:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277128832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578945.894658:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789578945.894703:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277128832:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789578946.723663:0:13358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789578946.724552:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578947.747562:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578948.771599:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578949.240013:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578949.240055:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578949.240123:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320192 00000100:00100000:3.0:1789578949.240134:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320192 00000100:00100000:2.0:1789578949.240154:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261319936 00000100:00100000:2.0:1789578949.240160:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261319936 00000100:00100000:3.0:1789578949.240208:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:2.0:1789578949.240214:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 332 00000100:00100000:3.0:1789578949.240223:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261320192:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578949.240229:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261319936:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:1.0:1789578949.240383:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578949.240470:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261319936:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 246us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578949.240478:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 332 00000100:00100000:3.0:1789578949.241619:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261320192:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 1394us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578949.241630:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:3.0:1789578949.243714:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578949.243754:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578949.243792:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578949.244781:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320448 00000100:00100000:1.0:1789578949.244792:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320448 00000100:00100000:1.0:1789578949.244908:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320064 00000100:00100000:1.0:1789578949.244912:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320064 00000100:00100000:0.0:1789578949.245015:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320320 00000100:00100000:0.0:1789578949.245021:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320320 00000100:00080000:3.0:1789578949.245046:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578949.245050:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578949.245085:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:3.0:1789578949.245096:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261320448:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578949.245177:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261320448:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 84us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578949.245186:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:1.0:1789578949.248250:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:1.0:1789578949.248266:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261320064:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578949.248347:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261320064:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 85us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578949.248373:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:0.0:1789578949.249078:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:0.0:1789578949.249089:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261320320:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578949.249147:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261320320:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 60us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.249154:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 190 00010000:00010000:2.0:1789578949.801291:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578949.987466:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789578949.987490:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277128960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578949.987557:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578949.987595:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277129216:0@lo:400:kworker.0 00000100:00100000:3.0:1789578949.987637:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.987667:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277129344:0@lo:400:kworker.0 00000100:00100000:3.0:1789578949.987680:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277129728:0@lo:400:kworker.0 00000100:00100000:3.0:1789578949.987710:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.987730:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578949.987741:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277130240:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.987761:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277129856:0@lo:400:kworker.0 00000100:00100000:3.0:1789578949.987775:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.987792:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578949.987806:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277129088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578949.987811:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277130752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578949.987817:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130240 00000100:00100000:0.0:1789578949.987823:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277130368:0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.987825:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130240 00000100:00100000:3.0:1789578949.987834:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578949.987843:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129216 00000100:00100000:1.0:1789578949.987848:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129216 00000100:00100000:3.0:1789578949.987865:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789578949.987870:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277130880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578949.987877:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578949.987884:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789578949.987891:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789578949.987895:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277129216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578949.987901:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578949.987906:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277130240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.987930:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277128960 00000100:00100000:0.0:1789578949.987936:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277128960 00000100:00100000:3.0:1789578949.987940:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129728 00000100:00100000:3.0:1789578949.987946:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129728 00000100:00100000:2.0:1789578949.987967:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277130240:12345-0@lo:400:kworker.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.987967:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130752 00000100:00100000:0.0:1789578949.987973:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130752 00000100:00100000:2.0:1789578949.987979:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789578949.987983:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789578949.987994:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277129728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.987998:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130880 00000100:00100000:0.0:1789578949.988002:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130880 00000100:00080000:2.0:1789578949.988009:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578949.988014:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578949.988031:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789578949.988039:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277129728:12345-0@lo:400:kworker.0 Request processed in 46us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988042:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277128960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578949.988048:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789578949.988052:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789578949.988062:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277130752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578949.988070:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789578949.988083:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578949.988129:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277128960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578949.988136:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277130752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988142:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789578949.988148:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789578949.988163:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789578949.988172:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277130880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578949.988184:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789578949.988187:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350ca80 x1876509277130752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578949.988200:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277130752:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789578949.988212:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ea300 x1876509277130240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.988219:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277130880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578949.988221:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277130240:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988233:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789578949.988234:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277129728:0@lo:400:kworker.0 00010000:00080000:2.0:1789578949.988257:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930350d880 x1876509277130880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.988262:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129344 00000100:00100000:2.0:1789578949.988266:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930350d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277130880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578949.988267:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129344 00000100:00100000:1.0:1789578949.988302:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277129216:12345-0@lo:400:kworker.0 Request processed in 408us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988303:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129856 00000100:00100000:0.0:1789578949.988308:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129856 00000100:00100000:2.0:1789578949.988312:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277129216:0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.988327:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789578949.988347:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130368 00000100:00100000:0.0:1789578949.988372:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130368 00000100:00100000:1.0:1789578949.988383:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988395:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789578949.988404:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277129344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.988406:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129088 00000100:00100000:1.0:1789578949.988408:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277129600:0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.988413:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129088 00000100:00100000:2.0:1789578949.988442:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789578949.988454:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277129088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578949.988456:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988460:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277129344:12345-0@lo:400:kworker.0 Request processed in 55us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988469:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00002000:00000024:2.0:1789578949.988470:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578949.988476:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277130112:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988485:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129600 00000100:00100000:0.0:1789578949.988490:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129600 00000100:00100000:2.0:1789578949.988512:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277129088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578949.988513:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988516:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789578949.988525:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789578949.988529:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277129856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.988537:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277130624:0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.988570:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988577:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277129856:12345-0@lo:400:kworker.0 Request processed in 50us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988584:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789578949.988597:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789578949.988604:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277130368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988631:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277130368:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988637:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789578949.988649:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789578949.988655:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277129600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988685:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277129600:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988692:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789578949.988725:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277129472:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988782:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277129984:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988806:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578949.988825:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277130496:0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.988837:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130112 00000100:00100000:2.0:1789578949.988842:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130112 00010000:00080000:1.0:1789578949.988857:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412ed80 x1876509277128960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.988858:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578949.988869:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130624 00000100:00100000:2.0:1789578949.988873:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130624 00000100:00100000:1.0:1789578949.988877:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277128960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578949.988903:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789578949.988904:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129472 00010000:00080000:1.0:1789578949.988907:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412fb80 x1876509277129088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.988910:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129472 00000100:00100000:2.0:1789578949.988916:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277130112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.988945:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789578949.988959:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277130112:12345-0@lo:400:kworker.0 Request processed in 43us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.988959:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277129472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.988972:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789578949.988987:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789578949.988996:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277130624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.989008:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277129472:12345-0@lo:400:kworker.0 Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.989015:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789578949.989033:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277130624:12345-0@lo:400:kworker.0 Request processed in 39us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.989038:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277129984 00000100:00100000:2.0:1789578949.989041:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789578949.989043:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277129984 00000100:00100000:0.0:1789578949.989072:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277130496 00000100:00100000:0.0:1789578949.989075:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277130496 00000100:00100000:0.0:1789578949.989100:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789578949.989124:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789578949.989124:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277129984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578949.989137:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277130496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.989165:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277129984:12345-0@lo:400:kworker.0 Request processed in 58us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578949.989172:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789578949.989181:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277130496:12345-0@lo:400:kworker.0 Request processed in 48us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578949.989189:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1789578949.989193:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578949.989197:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578949.989216:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277129472:0@lo:400:kworker.0 00010000:00080000:0.0:1789578949.989227:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ead80 x1876509277129984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.989236:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277129984:0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.989254:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277129088:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789578949.989260:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9c00 x1876509277130496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.989271:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277130496:0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.989275:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277129600:0@lo:400:kworker.0 00010000:00080000:1.0:1789578949.989291:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ea680 x1876509277130112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578949.989301:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277130112:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.989309:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277129344:0@lo:400:kworker.0 00010000:00080000:1.0:1789578949.989316:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e9180 x1876509277130624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578949.989327:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277129856:0@lo:400:kworker.0 00000100:00100000:1.0:1789578949.989328:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277130624:0@lo:400:kworker.0 00000100:00100000:0.0:1789578949.989345:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277130368:0@lo:400:kworker.0 00010000:00010000:3.0:1789578950.819700:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578951.011717:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578951.011746:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277131008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578951.011834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578951.011917:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131008 00000100:00100000:0.0:1789578951.011925:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131008 00000100:00100000:0.0:1789578951.011988:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789578951.011998:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277131008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578951.012046:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789578951.012125:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277131008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578951.012132:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789578951.012183:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277131008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578951.016716:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789578951.020339:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277131136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578951.020431:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578951.020671:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131136 00000100:00100000:1.0:1789578951.020690:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131136 00000100:00100000:1.0:1789578951.020738:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789578951.020748:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277131136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789578951.020781:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578951.020827:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277131136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578951.020834:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789578951.020978:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277131136:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789578951.846469:0:13507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:15:49 (1789578949) === 00010000:00010000:2.0:1789578951.849622:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578952.008379:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.008445:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.008510:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320576 00000100:00100000:2.0:1789578952.008520:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320576 00000100:00100000:2.0:1789578952.008587:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789578952.008608:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261320576:12345-192.168.203.37@tcp:41:mkdir.0 00000004:00000024:2.0:1789578952.008658:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578952.008698:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320704 00000100:00100000:3.0:1789578952.008703:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320704 00000100:00100000:3.0:1789578952.008732:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789578952.008740:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28fc5077-c53d-437a-bade-84c159d25114+7:10482:x1876509261320704:12345-192.168.203.37@tcp:700:mkdir.0 00000100:00100000:2.0:1789578952.008755:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261320576:12345-192.168.203.37@tcp:41:mkdir.0 Request processed in 148us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.008762:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789578952.008796:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28fc5077-c53d-437a-bade-84c159d25114+6:10482:x1876509261320704:12345-192.168.203.37@tcp:700:mkdir.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578952.008804:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00080000:0.0:1789578952.008921:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578952.013761:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578952.013896:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261320960 00000100:00100000:3.0:1789578952.013905:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261320960 00000100:00100000:3.0:1789578952.013953:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789578952.013963:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:10482:x1876509261320960:12345-192.168.203.37@tcp:36:mkdir.0 00010000:00010000:3.0:1789578952.014013:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578952.014112:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f20d05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdee expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014139:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789578952.014149:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578952.014228:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014241:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014252:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014280:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014287:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014292:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014798:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014809:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014816:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578952.014830:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043fa57bc reply state 00000000dd3bc67c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014847:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014853:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:3.0:1789578952.014856:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578952.014858:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789578952.014862:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789578952.014868:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014875:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014881:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014887:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578952.014891:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014899:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014906:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939405f07100) 00010000:00010000:3.0:1789578952.014908:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578952.014912:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014917:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20e63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578952.014941:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043fa57bc reply state 00000000dd3bc67c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014949:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.014955:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939405f07900) 00010000:00010000:3.0:1789578952.014957:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578952.014959:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789578952.015034:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+7:10482:x1876509261320960:12345-192.168.203.37@tcp:36:mkdir.0 Request processed in 1071us (1280us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789578952.015042:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789578952.027406:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.027446:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321088 00000100:00100000:1.0:1789578952.027456:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321088 00000100:00100000:1.0:1789578952.027507:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789578952.027516:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:10483:x1876509261321088:12345-192.168.203.37@tcp:101:chmod.0 00010000:00010000:1.0:1789578952.027537:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578952.027558:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe81 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027618:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027632:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027643:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578952.027687:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789578952.027691:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578952.027724:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027763:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe81 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027778:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe81 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.027786:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939409059400) 00010000:00010000:1.0:1789578952.027789:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789578952.027792:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:1.0:1789578952.027842:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+8:10483:x1876509261321088:12345-192.168.203.37@tcp:101:chmod.0 Request processed in 327us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578952.027848:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789578952.035120:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.035200:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321344 00000100:00100000:2.0:1789578952.035210:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321344 00000100:00100000:2.0:1789578952.035267:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789578952.035277:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+8:10483:x1876509261321344:12345-192.168.203.37@tcp:36:chmod.0 00010000:00010000:2.0:1789578952.035328:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578952.035381:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20e7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe81 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.035399:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939409059400) 00010000:00010000:2.0:1789578952.035412:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789578952.035435:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.035448:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.035459:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789578952.035662:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018bcfe03 reply state 00000000dfad8507 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.035675:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.035689:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:2.0:1789578952.035691:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789578952.035694:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789578952.035701:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789578952.035777:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+9:10483:x1876509261321344:12345-192.168.203.37@tcp:36:chmod.0 Request processed in 501us (666us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789578952.035784:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789578952.055612:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.055657:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321472 00000100:00100000:2.0:1789578952.055667:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321472 00000100:00100000:2.0:1789578952.055722:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789578952.055732:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+9:10484:x1876509261321472:12345-192.168.203.37@tcp:101:chown.0 00010000:00010000:2.0:1789578952.055757:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578952.055777:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.055845:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.055862:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.055873:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578952.055915:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789578952.055988:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578952.056028:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.056072:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe88 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.056090:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe88 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.056110:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:2.0:1789578952.056113:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578952.056117:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789578952.056176:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+10:10484:x1876509261321472:12345-192.168.203.37@tcp:101:chown.0 Request processed in 444us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.056184:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:1.0:1789578952.065340:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.065505:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321600 00000100:00100000:2.0:1789578952.065515:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321600 00000100:00100000:2.0:1789578952.065579:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789578952.065589:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+10:10484:x1876509261321600:12345-192.168.203.37@tcp:101:chown.0 00010000:00010000:2.0:1789578952.065609:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578952.065640:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe8f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065703:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065716:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065727:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065752:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065760:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065767:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065836:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065844:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065850:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578952.065892:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789578952.065896:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578952.065912:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065990:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.065998:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066004:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066020:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578952.066024:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066032:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066043:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:2.0:1789578952.066047:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578952.066052:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066057:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066070:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066075:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066080:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066085:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578952.066087:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066103:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066121:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939405f07900) 00010000:00010000:2.0:1789578952.066124:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578952.066127:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066133:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20ea9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066158:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe8f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066170:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe8f expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.066178:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:2.0:1789578952.066180:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578952.066182:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae400, rc 0) 00000100:00100000:2.0:1789578952.066247:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+11:10484:x1876509261321600:12345-192.168.203.37@tcp:101:chown.0 Request processed in 660us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.066255:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:1.0:1789578952.071141:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.071217:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321728 00000100:00100000:2.0:1789578952.071228:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321728 00000100:00100000:2.0:1789578952.071334:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789578952.071344:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+11:10484:x1876509261321728:12345-192.168.203.37@tcp:900:chown.0 00000100:00100000:2.0:1789578952.071468:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+11:10484:x1876509261321728:12345-192.168.203.37@tcp:900:chown.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.071475:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789578952.095125:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.095162:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261321984 00000100:00100000:1.0:1789578952.095171:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261321984 00000100:00100000:1.0:1789578952.095221:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:1.0:1789578952.095231:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+11:10484:x1876509261321984:12345-192.168.203.37@tcp:36:chown.0 00010000:00010000:1.0:1789578952.095285:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578952.095311:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f20eb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe8f expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.098780:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:1.0:1789578952.098787:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578952.098827:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.098844:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.098857:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789578952.112242:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1789578952.112311:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e392660 reply state 00000000756fe521 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.112345:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.112378:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:3.0:1789578952.112382:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789578952.112387:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789578952.112398:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1789578952.112487:0:6491:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789578952.112510:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+9:10484:x1876509261321984:12345-192.168.203.37@tcp:36:chown.0 Request processed in 17276us (17391us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789578952.112521:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00010000:00010000:2.0:1789578952.112747:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112757:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112764:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112769:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578952.112774:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112782:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112791:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:2.0:1789578952.112794:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789578952.112797:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.112804:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f20eb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114676:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114723:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114730:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114737:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.114741:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114749:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114764:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939405f07900) 00010000:00010000:0.0:1789578952.114768:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.114773:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114780:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f20e6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114801:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114807:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114814:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114819:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.114829:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114837:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114848:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939405f07800) 00010000:00010000:0.0:1789578952.114850:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.114853:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114860:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f20e71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114877:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114884:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114890:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114897:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.114901:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114908:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114928:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:0.0:1789578952.114937:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789578952.114948:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.114955:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f20e86 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578952.162591:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.162684:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261322112 00000100:00100000:2.0:1789578952.162705:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261322112 00000100:00100000:2.0:1789578952.162770:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789578952.162780:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+6:10485:x1876509261322112:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:2.0:1789578952.162806:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578952.162831:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe96 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789578952.167464:0:6492:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4545us 00010000:00010000:0.0:1789578952.191021:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191044:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191056:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191074:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191082:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191089:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191212:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191219:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191226:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578952.191256:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789578952.191266:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578952.191310:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191324:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191330:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191336:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191342:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.191345:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191391:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191403:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:0.0:1789578952.191406:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.191411:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191416:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191428:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191433:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191450:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191455:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.191457:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191464:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191471:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939302356900) 00010000:00010000:0.0:1789578952.191473:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.191476:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191481:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20ecc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191522:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe96 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191538:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe96 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.191544:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:0.0:1789578952.191546:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789578952.191549:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436c00, rc 0) 00000100:00100000:0.0:1789578952.191615:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+7:10485:x1876509261322112:12345-192.168.203.37@tcp:101:touch.500 Request processed in 28836us (29033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578952.191633:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:3.0:1789578952.198949:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.199169:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261322368 00000100:00100000:2.0:1789578952.199179:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261322368 00000100:00100000:2.0:1789578952.199236:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:2.0:1789578952.199246:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:10485:x1876509261322368:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:2.0:1789578952.199266:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578952.199328:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20eda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebe9d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199465:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199480:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199491:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199549:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199556:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.199563:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789578952.200272:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789578952.200949:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20eef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.200973:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.200983:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20eef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201018:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201024:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201030:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201036:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578952.201039:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201046:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201057:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:2.0:1789578952.201060:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578952.201064:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201071:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f20ee1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789578952.201083:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002648d1b2 reply state 00000000dab60a36 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201113:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201120:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff93942ef55b00) 00010000:00010000:2.0:1789578952.201122:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789578952.201125:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789578952.201157:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20eda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe9d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201171:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20eef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe9d expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578952.201178:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93942ef55000) 00010000:00010000:2.0:1789578952.201180:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789578952.201182:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789578952.201240:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+10:10485:x1876509261322368:12345-192.168.203.37@tcp:101:touch.500 Request processed in 1996us (2300us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789578952.201248:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:2.0:1789578952.207028:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.207115:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261322624 00000100:00100000:0.0:1789578952.207126:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261322624 00000100:00100000:0.0:1789578952.207188:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:0.0:1789578952.207198:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+10:10485:x1876509261322624:12345-192.168.203.37@tcp:36:touch.500 00010000:00010000:0.0:1789578952.207255:0:9792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578952.207281:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f20eef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe9d expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.207303:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93942ef55000) 00010000:00010000:0.0:1789578952.207313:0:9792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789578952.207416:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.207430:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.207441:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789578952.207542:0:9792:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a0e19ca reply state 00000000ef4101bd transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.207554:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.207560:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:0.0:1789578952.207563:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789578952.207566:0:9792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789578952.207670:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+11:10485:x1876509261322624:12345-192.168.203.37@tcp:36:touch.500 Request processed in 472us (649us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789578952.207677:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789578952.212173:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.212266:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261322752 00000100:00100000:1.0:1789578952.212277:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261322752 00000100:00100000:1.0:1789578952.212331:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789578952.212342:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+11:10485:x1876509261322752:12345-192.168.203.37@tcp:101:touch.500 00010000:00010000:1.0:1789578952.212397:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578952.212418:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebea4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.212474:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20f04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebea4 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.212490:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20f04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebea4 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.212509:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:1.0:1789578952.212512:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789578952.212515:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:1.0:1789578952.212572:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+12:10485:x1876509261322752:12345-192.168.203.37@tcp:101:touch.500 Request processed in 231us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578952.212579:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789578952.216984:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.217734:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261322880 00000100:00100000:2.0:1789578952.217746:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261322880 00000100:00100000:2.0:1789578952.217865:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:2.0:1789578952.217873:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261322880:12345-192.168.203.37@tcp:8:touch.500 00010000:00080000:2.0:1789578952.217955:0:8405:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1789578952.217988:0:8405:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f20f0b 00002000:00100000:2.0:1789578952.217999:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28fc5077-c53d-437a-bade-84c159d25114/ffff93930206c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789578952.218033:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789578952.218115:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789578952.218143:0:8405:0:(import.c:65:import_set_state_nolock()) ffff93930206a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789578952.218204:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261322880:12345-192.168.203.37@tcp:8:touch.500 Request processed in 330us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.218212:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789578952.220442:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578952.220647:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261323008 00000100:00100000:2.0:1789578952.220657:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261323008 00000100:00080000:0.0:1789578952.220815:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578952.220915:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789578952.220925:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261323008:12345-192.168.203.37@tcp:2:touch.500 00000001:00080000:3.0:1789578952.233892:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1789578952.233908:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000100:00100000:2.0:1789578952.234235:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:0:x1876509261323008:12345-192.168.203.37@tcp:2:touch.500 Request processed in 13305us (13795us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789578952.234247:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:3.0:1789578952.240267:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.241063:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261323264 00000100:00100000:0.0:1789578952.241109:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261323264 00000100:00100000:0.0:1789578952.241194:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:0.0:1789578952.241206:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+12:10485:x1876509261323264:12345-192.168.203.37@tcp:35:touch.500 00000100:00100000:0.0:1789578952.243042:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+13:10485:x1876509261323264:12345-192.168.203.37@tcp:35:touch.500 Request processed in 1830us (2790us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789578952.243055:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:1.0:1789578952.258299:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.258542:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261323392 00000100:00100000:0.0:1789578952.258551:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261323392 00000100:00100000:0.0:1789578952.258608:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:0.0:1789578952.258618:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+13:10486:x1876509261323392:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:0.0:1789578952.258932:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578952.258951:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebeab expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259016:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259029:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259040:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578952.259082:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789578952.259106:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578952.259146:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259173:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeab expref: 15 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259190:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeab expref: 14 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.259199:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:0.0:1789578952.259201:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789578952.259204:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436400, rc 0) 00000100:00100000:0.0:1789578952.259270:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+14:10486:x1876509261323392:12345-192.168.203.37@tcp:101:rm.0 Request processed in 652us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578952.259277:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789578952.271522:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.272018:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261323648 00000100:00100000:1.0:1789578952.272028:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261323648 00000100:00100000:1.0:1789578952.272161:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789578952.272181:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+14:10486:x1876509261323648:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:1.0:1789578952.272212:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578952.272247:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f20f20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebeb2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578952.273295:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789578952.273574:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f20f20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeb2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.273592:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:0.0:1789578952.273605:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789578952.273611:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f20f20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeb2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.273626:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519400, rc 0) 00000100:00100000:0.0:1789578952.273717:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+15:10486:x1876509261323648:12345-192.168.203.37@tcp:101:rm.0 Request processed in 1540us (2197us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1789578952.273742:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:0.0:1789578952.283782:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.283924:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261323776 00000100:00100000:1.0:1789578952.283933:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261323776 00000100:00100000:1.0:1789578952.284007:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789578952.284017:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+15:10486:x1876509261323776:12345-192.168.203.37@tcp:37:rm.0 00000100:00100000:2.0:1789578952.293322:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+15:10486:x1876509261323776:12345-192.168.203.37@tcp:37:rm.0 Request processed in 9285us (9528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.293339:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789578952.305918:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.307262:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261324032 00000100:00100000:0.0:1789578952.307926:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261324032 00000100:00100000:0.0:1789578952.308053:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789578952.308076:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b607050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+15:10486:x1876509261324032:12345-192.168.203.37@tcp:35:rm.0 00000100:00100000:0.0:1789578952.308929:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b607050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+16:10486:x1876509261324032:12345-192.168.203.37@tcp:35:rm.0 Request processed in 853us (3040us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789578952.308938:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789578952.320127:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578952.320330:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261324288 00000100:00100000:3.0:1789578952.320423:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261324288 00000100:00100000:3.0:1789578952.320510:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789578952.320534:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+16:10486:x1876509261324288:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:3.0:1789578952.320571:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578952.320605:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebeb9 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.320768:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f20f35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.320798:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f20f35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.320823:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f20f35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578952.320834:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789578952.321104:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeb9 expref: 19 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.321148:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f20f35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeb9 expref: 18 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.321157:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:3.0:1789578952.321173:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789578952.321177:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789578952.321262:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261324288:12345-192.168.203.37@tcp:101:rm.0 Request processed in 743us (1143us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789578952.321280:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:1.0:1789578952.334193:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.335147:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261324416 00000100:00100000:0.0:1789578952.335160:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261324416 00000100:00100000:2.0:1789578952.335921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:2.0:1789578952.335934:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261324416:12345-192.168.203.37@tcp:41:rm.0 00000004:00000024:2.0:1789578952.335994:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789578952.336070:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261324416:12345-192.168.203.37@tcp:41:rm.0 Request processed in 138us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578952.336077:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:1.0:1789578952.341048:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578952.341137:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261324544 00000100:00100000:0.0:1789578952.341146:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261324544 00000100:00100000:0.0:1789578952.341201:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:0.0:1789578952.341210:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261324544:12345-192.168.203.37@tcp:101:rm.0 00010000:00010000:0.0:1789578952.341228:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578952.341247:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f20f43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebec0 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341321:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341497:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341512:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341525:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341544:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341551:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341649:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341658:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341665:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578952.341765:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789578952.341770:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578952.341789:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341801:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341808:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341815:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341821:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341836:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.341840:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341847:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341859:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:0.0:1789578952.341861:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.341866:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341872:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436000/0xd90373d592f20f4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341885:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341890:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341896:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341901:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578952.341903:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341909:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341926:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff93942ef55b00) 00010000:00010000:0.0:1789578952.341928:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578952.341930:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341936:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437600/0xd90373d592f20f51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341961:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f20f43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec0 expref: 20 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341973:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec0 expref: 19 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578952.341979:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:0.0:1789578952.341982:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789578952.341984:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789578952.342084:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+19:10486:x1876509261324544:12345-192.168.203.37@tcp:101:rm.0 Request processed in 874us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578952.342102:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:1.0:1789578952.348176:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578952.348260:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261324800 00000100:00100000:3.0:1789578952.348279:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261324800 00000100:00100000:3.0:1789578952.348385:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:3.0:1789578952.348397:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+19:10486:x1876509261324800:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:3.0:1789578952.348448:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789578952.348475:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f20f58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec0 expref: 19 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348498:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f20f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebea4 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348509:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:3.0:1789578952.348521:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f20f19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeab expref: 17 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348530:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:3.0:1789578952.348546:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578952.348566:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348580:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348589:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348609:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348617:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.348638:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349131:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349142:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349149:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789578952.349859:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789578952.349872:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307482520858ns, next at 308482518265ns, rc = 0 00010000:00010000:3.0:1789578952.349921:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349943:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349952:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349960:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349967:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349973:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.349985:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789578952.350003:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350009:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350014:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350020:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578952.350025:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350033:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350050:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:3.0:1789578952.350053:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789578952.350058:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350064:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f20f6d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350080:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350087:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350108:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350113:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578952.350116:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350121:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350129:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:3.0:1789578952.350131:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578952.350133:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350140:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37200/0xd90373d592f20f5f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578952.350159:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa5975c4 reply state 00000000461e6387 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350170:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578952.350178:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff93942ef55b00) 00010000:00010000:3.0:1789578952.350180:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578952.350183:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789578952.350282:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261324800:12345-192.168.203.37@tcp:36:rm.0 Request processed in 1884us (2112us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789578952.350290:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00010000:00010000:1.0:1789578952.355580:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789578952.355594:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.355614:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789578952.355806:0:10312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.355818:0:10312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.355846:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:1.0:1789578952.355867:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789578952.355874:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.355880:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f20f74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.355898:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578952.355900:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578952.355902:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578952.358244:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578952.358548:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325056 00000100:00100000:3.0:1789578952.358560:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325056 00000100:00100000:3.0:1789578952.358619:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789578952.358661:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261325056:12345-192.168.203.37@tcp:35:rm.0 00000100:00100000:3.0:1789578952.359176:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+19:10486:x1876509261325056:12345-192.168.203.37@tcp:35:rm.0 Request processed in 517us (938us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789578952.359184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789578952.378138:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578952.378825:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325312 00000100:00100000:1.0:1789578952.378837:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325312 00000100:00100000:1.0:1789578952.378899:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789578952.378911:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+19:10486:x1876509261325312:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:1.0:1789578952.378967:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789578952.378993:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f20f35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeb9 expref: 19 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379016:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f20ed3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe96 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379027:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939302356300) 00010000:00010000:1.0:1789578952.379044:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f20e94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe88 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379055:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef55a00) 00010000:00010000:1.0:1789578952.379062:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578952.379086:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379124:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379135:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379148:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379155:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379161:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379240:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379248:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.379254:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578952.381264:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789578952.381799:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381812:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381819:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381838:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578952.381843:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381851:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381867:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789578952.381870:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789578952.381875:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381881:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f20f89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381908:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381914:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381921:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381926:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578952.381929:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381935:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381952:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126300) 00010000:00010000:1.0:1789578952.381955:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578952.381958:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381964:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f20f7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789578952.381978:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076bc954c reply state 000000008a7bd739 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381990:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578952.381997:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939410126400) 00010000:00010000:1.0:1789578952.381999:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789578952.382002:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789578952.382137:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:10486:x1876509261325312:12345-192.168.203.37@tcp:36:rm.0 Request processed in 3225us (4003us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789578952.382146:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00010000:00010000:2.0:1789578952.867706:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578953.893114:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578954.357989:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358771:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358821:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358847:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358901:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358925:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578954.358970:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325696 00000100:00100000:1.0:1789578954.358981:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325696 00000100:00100000:1.0:1789578954.359115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325952 00000100:00100000:1.0:1789578954.359131:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325952 00000100:00100000:1.0:1789578954.359262:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325568 00000100:00100000:1.0:1789578954.359326:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325568 00000100:00100000:1.0:1789578954.359746:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326080 00000100:00100000:1.0:1789578954.359750:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326080 00000100:00100000:1.0:1789578954.359773:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:1.0:1789578954.359782:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261325696:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578954.359853:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261325696:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 72us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578954.359861:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:1.0:1789578954.359877:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:1.0:1789578954.359884:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261325952:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578954.359909:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261325952:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578954.359914:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:1.0:1789578954.359926:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:1.0:1789578954.359932:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2394:x1876509261325568:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578954.359958:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2394:x1876509261325568:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578954.359963:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:1.0:1789578954.359975:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:1.0:1789578954.359981:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261326080:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578954.360002:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261326080:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578954.360007:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:0.0:1789578954.361725:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325824 00000100:00100000:0.0:1789578954.361742:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325824 00000100:00100000:0.0:1789578954.361835:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789578954.361847:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261325824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578954.361930:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261325824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 87us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578954.361951:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00080000:0.0:1789578954.361973:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578954.361977:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578954.361979:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578954.367459:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261325440 00000100:00100000:2.0:1789578954.367485:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261325440 00000100:00100000:3.0:1789578954.368430:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 334 00000100:00100000:3.0:1789578954.368442:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261325440:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578954.368515:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261325440:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 76us (10537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578954.368522:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 334 00010000:00010000:3.0:1789578954.916558:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578955.107725:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277131264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578955.107832:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.107917:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131264 00000100:00100000:3.0:1789578955.107927:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131264 00000100:00100000:3.0:1789578955.107985:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789578955.107996:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277131264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789578955.108028:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578955.108083:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277131264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.108090:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789578955.108111:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789578955.108138:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939437204000 x1876509277131264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.108156:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277131264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578955.108289:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277131520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578955.108321:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789578955.108420:0:8663:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310241067774ns, next at 311241064987ns, rc = 0 00000100:00100000:0.0:1789578955.108442:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131520 00000100:00100000:0.0:1789578955.108445:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131520 00000100:00100000:0.0:1789578955.108470:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789578955.108476:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277131520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578955.108491:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578955.108519:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277131520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578955.108525:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789578955.108832:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277131648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578955.108858:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578955.108875:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277132160:0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.108898:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578955.108914:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277132672:0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.108942:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.108962:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131648 00000100:00100000:1.0:1789578955.108964:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789578955.108968:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131648 00000100:00100000:1.0:1789578955.108973:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277132032:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109004:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789578955.109026:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277131648:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578955.109033:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789578955.109043:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578955.109052:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277132544:0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.109097:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109098:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277131648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.109107:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789578955.109120:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277133056:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109132:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132160 00000100:00100000:3.0:1789578955.109137:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132160 00000100:00100000:1.0:1789578955.109145:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109168:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132544 00000100:00100000:3.0:1789578955.109171:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132544 00010000:00080000:1.0:1789578955.109186:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304239880 x1876509277131648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.109198:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789578955.109204:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277131648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578955.109207:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277132160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.109249:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789578955.109257:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277132160:12345-0@lo:400:kworker.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578955.109261:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277132544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109271:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789578955.109303:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277132544:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578955.109310:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:3.0:1789578955.109314:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40c700 x1876509277132544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.109325:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277132544:0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.109334:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132672 00000100:00100000:1.0:1789578955.109339:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132672 00000100:00100000:3.0:1789578955.109341:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277132160:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109382:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277131392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578955.109408:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109427:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277131904:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109446:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109466:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277132416:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109485:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109499:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277132928:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109516:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109533:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789578955.109539:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277131776:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109564:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109583:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277132288:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109619:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277132800:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109634:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578955.109654:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132032 00000100:00100000:3.0:1789578955.109663:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132032 00000100:00100000:3.0:1789578955.109687:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132288 00000100:00100000:3.0:1789578955.109689:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132288 00000100:00100000:3.0:1789578955.109702:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789578955.109708:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277132032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109744:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277132032:12345-0@lo:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.109750:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789578955.109761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789578955.109767:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277132288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109797:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277132288:12345-0@lo:400:kworker.0 Request processed in 30us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.109803:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789578955.109820:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131904 00000100:00100000:3.0:1789578955.109823:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131904 00000100:00100000:3.0:1789578955.109837:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132416 00000100:00100000:3.0:1789578955.109839:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132416 00000100:00100000:3.0:1789578955.109850:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132928 00000100:00100000:3.0:1789578955.109852:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132928 00000100:00100000:3.0:1789578955.109864:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277132800 00000100:00100000:3.0:1789578955.109866:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277132800 00000100:00100000:3.0:1789578955.109878:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789578955.109883:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277131904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.109918:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277131904:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578955.109923:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131776 00000100:00100000:3.0:1789578955.109926:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789578955.109929:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131776 00000100:00100000:3.0:1789578955.109943:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789578955.109951:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277132416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578955.109970:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789578955.109980:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.110004:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277132416:12345-0@lo:400:kworker.0 Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.110011:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789578955.110024:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277131776:12345-0@lo:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.110031:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789578955.110035:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789578955.110043:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277132928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.110088:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277132928:12345-0@lo:400:kworker.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.110094:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789578955.110105:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789578955.110110:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277132800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.110133:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277132800:12345-0@lo:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.110138:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1789578955.110164:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578955.110168:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578955.110170:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578955.110192:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277132032:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.110211:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277131392 00000100:00100000:3.0:1789578955.110214:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277131392 00000100:00100000:3.0:1789578955.110247:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789578955.110253:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277131392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789578955.110265:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789578955.110452:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412ed80 x1876509277131520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578955.110467:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277131520:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789578955.111511:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578955.112722:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133056 00000100:00100000:0.0:1789578955.112733:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133056 00000100:00100000:0.0:1789578955.112788:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789578955.112798:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277133056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578955.112890:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277133056:12345-0@lo:400:kworker.0 Request processed in 94us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578955.112905:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789578955.113292:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789578955.113303:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277132672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578955.113366:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277132672:12345-0@lo:400:kworker.0 Request processed in 50us (4408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578955.113373:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789578955.114556:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277131392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4298us (5142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578955.114566:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789578955.114622:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304171c00 x1876509277133056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.114649:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277133056:0@lo:400:kworker.0 00010000:00080000:3.0:1789578955.114666:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93940f40d500 x1876509277132672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.114675:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277132672:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.114736:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277131776:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.114747:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277132288:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.114758:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277132800:0@lo:400:kworker.0 00010000:00080000:3.0:1789578955.114768:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930412fb80 x1876509277131392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.114784:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277131392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578955.114795:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277131904:0@lo:400:kworker.0 00000100:00100000:3.0:1789578955.114806:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277132416:0@lo:400:kworker.0 00010000:00080000:3.0:1789578955.114817:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304170380 x1876509277132928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578955.114825:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277132928:0@lo:400:kworker.0 00010000:00010000:2.0:1789578955.941727:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578956.134236:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578956.134261:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277133184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578956.134331:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578956.134548:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578956.134627:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277133312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578956.134658:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578956.134694:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133184 00000100:00100000:3.0:1789578956.134701:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133184 00000100:00100000:3.0:1789578956.134761:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133312 00000100:00100000:3.0:1789578956.134764:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133312 00000100:00100000:3.0:1789578956.134781:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789578956.134788:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277133184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578956.134820:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789578956.134834:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789578956.134842:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277133312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578956.134860:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789578956.134864:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277133184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578956.134870:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789578956.134912:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277133312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578956.135076:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277133312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578956.135083:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789578956.135115:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277133184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789578956.968422:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789578957.274987:0:13655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1789578957.673086:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789578957.673182:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789578957.673193:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789578957.673257:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673270:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673278:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673283:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578957.673287:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673294:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673324:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff93942ef55b00) 00010000:00010000:1.0:1789578957.673327:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578957.673333:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673339:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20ee8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673520:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673527:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673533:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673537:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578957.673541:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673546:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673556:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939302356900) 00010000:00010000:1.0:1789578957.673558:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578957.673561:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673567:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f20efd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673608:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673615:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673621:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673625:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578957.673628:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673633:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673642:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa373426d (ffff93942ef55b00) 00010000:00010000:1.0:1789578957.673644:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578957.673647:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673653:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f20f66 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa373426d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673703:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673710:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673716:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673727:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578957.673730:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673736:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673744:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939410126400) 00010000:00010000:1.0:1789578957.673747:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578957.673749:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578957.673755:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f20f82 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578957.675932:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578957.676029:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277133440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789578957.676099:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578957.680041:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133440 00000100:00100000:0.0:1789578957.680063:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133440 00000100:00100000:0.0:1789578957.680137:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789578957.680155:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277133440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789578957.680184:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1789578957.680215:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aaacec7, atime: 0x6aaacec7, ctime: 0x6aaacec7, blocks: 0x0 00010000:00010000:0.0:1789578957.680223:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578957.680239:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:0.0:1789578957.680243:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578957.680288:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578957.680306:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578957.680317:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578957.680325:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578957.680363:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789578957.680384:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578957.680393:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578957.680404:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789578957.680408:0:9493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578957.680418:0:9493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578957.680436:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578957.680446:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578957.680448:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578957.680450:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789578957.680514:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789578957.680680:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f20f90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578957.680864:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277133440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 719us (4764us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789578957.680872:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789578957.681116:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939304239c00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789578957.681123:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277133440:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789578957.988667:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789578958.393848:0:13703:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc473de410 20000000:00000080:3.0:1789578958.393864:0:13703:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939303a1b000 uarg=0000000000000000 20000000:01000000:3.0:1789578958.393901:0:13703:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789578958.393907:0:13703:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789578958.393911:0:13703:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789578958.394291:0:13704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789578958.394534:0:13703:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789578958.398466:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789578958.398502:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789578958.398518:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789578958.398532:0:13703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789578958.398549:0:13703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398569:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398590:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398599:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e2b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398605:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398612:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e47 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398619:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20e55 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398626:0:13703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398660:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398674:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 23 pid: 6485 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.398688:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133568:0@lo:104: 00000100:00100000:3.0:1789578958.398746:0:13703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789578958.398841:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398860:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.398869:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133696:0@lo:104: 00010000:00010000:3.0:1789578958.398894:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398902:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.398908:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133824:0@lo:104: 00010000:00010000:3.0:1789578958.398925:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398931:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.398939:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133952:0@lo:104: 00010000:00010000:3.0:1789578958.398957:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.398967:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 12 pid: 6484 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.398976:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277134080:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578958.399022:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.399039:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 12 pid: 6482 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.399058:0:13703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277134208:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789578958.399080:0:13703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393034606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578958.400867:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789578958.400898:0:8419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578958.400928:0:8419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578958.400943:0:8419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578958.400959:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133568 00000100:00100000:1.0:1789578958.400966:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133568 00000100:00100000:1.0:1789578958.400999:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133696 00000100:00100000:1.0:1789578958.401001:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133696 00000100:00100000:1.0:1789578958.401009:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133824 00000100:00100000:1.0:1789578958.401011:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133824 00000100:00100000:1.0:1789578958.401019:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277133952 00000100:00100000:1.0:1789578958.401021:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277133952 00000100:00100000:1.0:1789578958.401031:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578958.401038:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394373eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+6:13703:x1876509277133568:12345-0@lo:104: 00010000:00010000:1.0:1789578958.401078:0:8419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401140:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789578958.401146:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394373eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+6:13703:x1876509277133568:12345-0@lo:104: Request processed in 109us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.401153:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789578958.401188:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578958.401194:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+5:13703:x1876509277133696:12345-0@lo:104: 00010000:00010000:1.0:1789578958.401201:0:8419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401227:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789578958.401231:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+5:13703:x1876509277133696:12345-0@lo:104: Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.401236:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789578958.401246:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789578958.401251:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+4:13703:x1876509277133824:12345-0@lo:104: 00010000:00010000:1.0:1789578958.401257:0:8419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401282:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789578958.401286:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+4:13703:x1876509277133824:12345-0@lo:104: Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.401303:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789578958.401313:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789578958.401319:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+3:13703:x1876509277133952:12345-0@lo:104: 00010000:00010000:1.0:1789578958.401330:0:8419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401379:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789578958.401383:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+3:13703:x1876509277133952:12345-0@lo:104: Request processed in 66us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.401389:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789578958.401412:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789578958.401417:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401425:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789578958.401429:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401437:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578958.401445:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578958.401451:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789578958.401480:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401487:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789578958.401503:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401510:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af400/0xd90373d592f20e55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e5c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401528:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789578958.401531:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401537:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789578958.401540:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.401547:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789578958.401554:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789578958.401560:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789578958.401570:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.401737:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133568:0@lo:104: 00000100:00100000:3.0:1789578958.401746:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133696:0@lo:104: 00000100:00100000:3.0:1789578958.401752:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133824:0@lo:104: 00000100:00100000:3.0:1789578958.401758:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277133952:0@lo:104: 00010000:00010000:2.0:1789578958.401877:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789578958.401883:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401890:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578958.401893:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401900:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578958.401906:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578958.401912:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578958.401926:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401933:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578958.401939:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401946:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af000/0xd90373d592f20e39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e40 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401955:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789578958.401958:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401970:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aec00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789578958.401973:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.401979:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789578958.401986:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578958.401991:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789578958.402002:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.402008:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789578958.402030:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.402037:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363aec00/0xd90373d592f20e2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e32 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578958.402055:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578958.402057:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578958.402059:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578958.402064:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578958.402071:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578958.402082:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277134720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578958.402115:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789578958.402198:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789578958.402227:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277134464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578958.402254:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578958.402364:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134720 00000100:00100000:3.0:1789578958.402369:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134720 00010000:00010000:3.0:1789578958.402391:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 24 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.402414:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134464 00000100:00100000:3.0:1789578958.402417:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134464 00010000:00010000:3.0:1789578958.402427:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 25 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.402443:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789578958.402450:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3616:x1876509277134720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789578958.402460:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578958.402464:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 25 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.402474:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 25 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.402493:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436600/0xd90373d592f20e32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20e2b expref: 25 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.402505:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578958.402560:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789578958.402569:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277134464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789578958.402589:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578958.402595:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 24 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578958.402604:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 24 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578958.402614:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437c00/0xd90373d592f20e4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20e47 expref: 24 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578958.402622:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578958.402672:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.402680:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f20e47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f20e4e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.402694:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578958.402696:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578958.402697:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578958.402703:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578958.402725:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277134336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789578958.402749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578958.402766:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578958.402771:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277134592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789578958.402786:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578958.402804:0:6476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789578958.402811:0:6476:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1789578958.402907:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134336 00000100:00100000:1.0:1789578958.402910:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134336 00010000:00010000:1.0:1789578958.402923:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 24 pid: 6485 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578958.402936:0:6476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789578958.402940:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134592 00000100:00100000:1.0:1789578958.402942:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134592 00010000:00010000:1.0:1789578958.402950:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 25 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578958.402959:0:6476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789578958.402963:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789578958.402968:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+25:3617:x1876509277134336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789578958.402975:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578958.402978:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 25 pid: 6485 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.402988:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 25 pid: 6485 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.402998:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518e00/0xd90373d592f20e5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20e55 expref: 25 pid: 6485 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.403017:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578958.403041:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277134336:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.403060:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789578958.403072:0:6476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789578958.403077:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789578958.403083:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3617:x1876509277134592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789578958.403089:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578958.403093:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.403102:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.403111:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436800/0xd90373d592f20e40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f20e39 expref: 23 pid: 6484 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.403120:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578958.403138:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3617:x1876509277134592:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.403143:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789578958.403167:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930412fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277134592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789578958.403175:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277134336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789578958.407040:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3616:x1876509277134720:12345-0@lo:103:ldlm_bl.0 Request processed in 4581us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578958.407066:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789578958.407553:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578958.407599:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578958.407619:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326208 00000100:00100000:1.0:1789578958.407636:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326208 00010000:00010000:1.0:1789578958.407664:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 13 pid: 6482 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578958.407685:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326336 00000100:00100000:1.0:1789578958.407688:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326336 00010000:00010000:1.0:1789578958.407697:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 14 pid: 6484 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578958.407709:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789578958.407716:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+14:2394:x1876509261326208:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578958.407730:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578958.407734:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 14 pid: 6482 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407745:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 14 pid: 6482 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407763:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578958.407807:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+14:2394:x1876509261326208:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.407812:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789578958.407838:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:1.0:1789578958.407844:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261326336:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578958.407852:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578958.407856:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 13 pid: 6484 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407865:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 13 pid: 6484 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407883:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407891:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407905:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407912:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407919:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407925:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407932:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789578958.407936:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407945:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407953:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578958.407962:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578958.407979:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261326336:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 135us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578958.407992:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00010000:00010000:3.0:1789578958.408261:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a37e00/0xd90373d592f20e24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe7a expref: 12 pid: 6484 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.408274:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277134080:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578958.408284:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518a00/0xd90373d592f20e1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe73 expref: 11 pid: 6482 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578958.408293:0:13703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1876509277134208:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578958.408319:0:13703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.408328:0:13703:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.408335:0:13703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578958.408342:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a37200/0xd90373d592f20f97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578958.409743:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3616:x1876509277134464:12345-0@lo:103:ldlm_bl.0 Request processed in 7171us (7482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578958.409755:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789578958.411797:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277134464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789578958.411809:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277134720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789578959.011596:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789578959.380150:0:13753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe166002a0 20000000:00000080:1.0:1789578959.380176:0:13753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939303b88000 uarg=0000000000000000 20000000:01000000:1.0:1789578959.380236:0:13753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789578959.380245:0:13753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789578959.380263:0:13753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789578959.387769:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789578959.389998:0:13753:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789578959.390515:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1789578959.390557:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1789578959.390590:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1789578959.390611:0:13753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789578959.390639:0:13753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390659:0:13753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390692:0:13753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390699:0:13753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390706:0:13753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390714:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390720:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578959.390726:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390735:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390750:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390758:0:13753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.390764:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437c00/0xd90373d592f20f9e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578959.486880:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.486933:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.486961:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.486993:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.487012:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.487037:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578959.487075:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326592 00000100:00100000:3.0:1789578959.487085:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326592 00000100:00100000:3.0:1789578959.487129:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327104 00000100:00100000:3.0:1789578959.487132:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327104 00000100:00100000:3.0:1789578959.487142:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326720 00000100:00100000:3.0:1789578959.487144:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326720 00000100:00100000:3.0:1789578959.487165:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326976 00000100:00100000:3.0:1789578959.487167:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326976 00000100:00100000:3.0:1789578959.487181:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:3.0:1789578959.487189:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326592:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578959.487270:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326592:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 81us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.487278:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:3.0:1789578959.487293:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:3.0:1789578959.487299:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261327104:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578959.487321:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261327104:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.487327:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:3.0:1789578959.487337:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:3.0:1789578959.487343:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326720:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578959.487562:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326720:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 218us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.487595:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:3.0:1789578959.487609:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:3.0:1789578959.487616:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261326976:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578959.487644:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261326976:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.487650:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:3.0:1789578959.487668:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326464 00000100:00100000:3.0:1789578959.487672:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326464 00000100:00100000:3.0:1789578959.487696:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 336 00000100:00100000:3.0:1789578959.487702:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2395:x1876509261326464:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578959.487726:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2395:x1876509261326464:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.487732:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 336 00000100:00080000:3.0:1789578959.487761:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578959.487764:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578959.489717:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261326848 00000100:00100000:0.0:1789578959.489736:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261326848 00000100:00100000:0.0:1789578959.489848:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:0.0:1789578959.489861:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326848:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578959.489956:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261326848:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 98us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.489964:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00080000:1.0:1789578959.490218:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789578959.844130:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789578959.844141:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939302b3c800 from 7 10000000:01000000:1.0:1789578959.844148:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789578959.844222:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.844236:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.844250:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578959.844283:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277134848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.844407:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.844578:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134848 00000100:00100000:3.0:1789578959.844589:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134848 00000100:00100000:3.0:1789578959.844655:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789578959.844666:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:6487:x1876509277134848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578959.844683:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789578959.844858:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8240 going to sleep for 11 seconds 00010000:00010000:3.0:1789578959.847892:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303a37200/0xd90373d592f20fac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20fa5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.847961:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303a37200/0xd90373d592f20fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20fa5 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.848002:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303a37200/0xd90373d592f20fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20fa5 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.848014:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37200, rc 0) 00000100:00100000:3.0:1789578959.848132:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277134848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3467us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.848144:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789578959.849314:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277134848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578959.849381:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.849398:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578959.849525:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277134976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.849588:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578959.849748:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277134976 00000100:00100000:0.0:1789578959.849757:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277134976 00000100:00100000:0.0:1789578959.849813:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789578959.849824:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277134976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.850000:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277134976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.850007:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789578959.855646:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789578959.855712:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277134976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.855799:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.855986:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578959.856032:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789578959.856244:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135104 00000100:00100000:2.0:1789578959.856253:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135104 00000100:00100000:2.0:1789578959.856330:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789578959.856340:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277135104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578959.856517:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277135104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578959.856525:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789578959.858135:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578959.859013:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13766:1876509277135232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.859139:0:13766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.859195:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789578959.859393:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135232 00000100:00100000:2.0:1789578959.859401:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135232 00000100:00100000:2.0:1789578959.859460:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789578959.859471:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:13766:x1876509277135232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578959.859633:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+21:13766:x1876509277135232:12345-0@lo:502:llog_process_th.0 Request processed in 163us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578959.859641:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789578959.859754:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13766:1876509277135232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789578959.859790:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578959.859803:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578959.859806:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789578959.859814:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939302b3c800 00000020:00000080:0.0:1789578959.859817:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789578959.859905:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578959.859918:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578959.859920:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789578959.859923:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789578959.859926:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578959.859927:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789578959.859931:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939302b3c800 00000020:00000080:0.0:1789578959.859933:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789578959.859979:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13766:1876509277135360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578959.860028:0:13766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578959.860073:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec240 going to sleep for 11 seconds 00000100:00100000:2.0:1789578959.860264:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135360 00000100:00100000:2.0:1789578959.860271:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135360 00000100:00100000:2.0:1789578959.860311:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789578959.860318:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:13766:x1876509277135360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578959.860433:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:13766:x1876509277135360:12345-0@lo:502:llog_process_th.0 Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578959.860450:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789578959.860662:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13766:1876509277135360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789578959.860688:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789578959.860693:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789578959.860695:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789578959.860700:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789578959.860938:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789578959.860968:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578959.860982:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.860995:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578959.861006:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578959.861009:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943711c800 from 7 10000000:01000000:2.0:1789578959.861012:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578959.861056:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.861066:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.861077:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578959.861096:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578959.861149:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578959.861184:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789578959.861473:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135488 00000100:00100000:0.0:1789578959.861480:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135488 00000100:00100000:0.0:1789578959.861520:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789578959.861528:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+21:6487:x1876509277135488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578959.861541:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578959.861556:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436000/0xd90373d592f20fba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20fb3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.861585:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436000/0xd90373d592f20fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20fb3 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.861597:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436000/0xd90373d592f20fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20fb3 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.861605:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436000, rc 0) 00000100:00100000:0.0:1789578959.861644:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277135488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.861650:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789578959.865222:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789578959.865265:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.865281:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578959.865476:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789578959.865557:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578959.865609:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789578959.865902:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135616 00000100:00100000:0.0:1789578959.865993:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135616 00000100:00100000:0.0:1789578959.866075:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789578959.866086:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277135616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.868496:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277135616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2397us (2924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.868514:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789578959.868743:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578959.868821:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789578959.868905:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.868958:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765540 going to sleep for 11 seconds 00000100:00100000:2.0:1789578959.869097:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135744 00000100:00100000:2.0:1789578959.869106:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135744 00000100:00100000:2.0:1789578959.869171:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789578959.869183:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277135744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789578959.869307:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277135744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578959.869315:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789578959.869582:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277135744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.887386:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13768:1876509277135872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578959.887516:0:13768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578959.887572:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789578959.890072:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277135872 00000100:00100000:3.0:1789578959.890095:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277135872 00000100:00100000:3.0:1789578959.890194:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789578959.890207:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:13768:x1876509277135872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.890457:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:13768:x1876509277135872:12345-0@lo:502:llog_process_th.0 Request processed in 252us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.890465:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789578959.890648:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13768:1876509277135872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789578959.890694:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578959.890705:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578959.890708:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789578959.890716:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943711c800 00000020:00000080:1.0:1789578959.890718:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789578959.890801:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578959.890804:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578959.890806:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789578959.890809:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789578959.890811:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578959.890812:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789578959.890816:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943711c800 00000020:00000080:1.0:1789578959.890818:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789578959.890888:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13768:1876509277136000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578959.890951:0:13768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578959.890992:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789578959.892025:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136000 00000100:00100000:3.0:1789578959.892046:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136000 00000100:00100000:3.0:1789578959.892113:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789578959.892130:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:13768:x1876509277136000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.893057:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+22:13768:x1876509277136000:12345-0@lo:502:llog_process_th.0 Request processed in 930us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.893070:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789578959.902769:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13768:1876509277136000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789578959.902877:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789578959.902892:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789578959.902895:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789578959.902900:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789578959.903152:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789578959.903183:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789578959.903197:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.903210:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789578959.903222:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789578959.903225:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f42d800 from 7 10000000:01000000:3.0:1789578959.903228:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789578959.903271:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.903280:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.903289:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578959.903313:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789578959.903434:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.903480:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765600 going to sleep for 11 seconds 00000100:00100000:0.0:1789578959.903552:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136128 00000100:00100000:0.0:1789578959.903561:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136128 00000100:00100000:0.0:1789578959.903623:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789578959.903634:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:6487:x1876509277136128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578959.903650:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578959.903665:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437600/0xd90373d592f20fc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20fc1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.903693:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437600/0xd90373d592f20fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20fc1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.903705:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437600/0xd90373d592f20fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20fc1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.903714:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437600, rc 0) 00000100:00100000:0.0:1789578959.903761:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939406230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.903769:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789578959.903815:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789578959.903829:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578959.903839:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578959.903927:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.903954:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578959.903977:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec840 going to sleep for 11 seconds 00000100:00100000:0.0:1789578959.903991:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136256 00000100:00100000:0.0:1789578959.903994:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136256 00000100:00100000:0.0:1789578959.904021:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789578959.904027:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.904165:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.904171:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789578959.904203:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.904232:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.904275:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578959.904287:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec840 going to sleep for 11 seconds 00000100:00100000:0.0:1789578959.904298:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136384 00000100:00100000:0.0:1789578959.904301:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136384 00000100:00100000:0.0:1789578959.904322:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789578959.904328:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.904437:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.904445:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789578959.904486:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578959.908526:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13771:1876509277136512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578959.908643:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578959.908690:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136512 00000100:00100000:0.0:1789578959.908698:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136512 00000100:00100000:0.0:1789578959.908749:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789578959.908759:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:13771:x1876509277136512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789578959.908893:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:13771:x1876509277136512:12345-0@lo:502:llog_process_th.0 Request processed in 134us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578959.908902:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000040:00080000:3.0:1789578959.909033:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789578959.909429:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec840 going to sleep for 11 seconds 00000100:00100000:3.0:1789578959.909464:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13771:1876509277136512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578959.909510:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578959.909522:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.909525:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789578959.909531:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940f42d800 00000020:00000080:3.0:1789578959.909534:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789578959.909602:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578959.909606:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.909607:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789578959.909609:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578959.909612:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.909613:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789578959.909616:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940f42d800 00000020:00000080:3.0:1789578959.909618:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578959.909659:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13771:1876509277136640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.909709:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.909737:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136640 00000100:00100000:3.0:1789578959.909742:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136640 00000100:00100000:3.0:1789578959.909768:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789578959.909774:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13771:x1876509277136640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.909874:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13771:x1876509277136640:12345-0@lo:502:llog_process_th.0 Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578959.909882:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789578959.911626:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394057656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578959.911671:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13771:1876509277136640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578959.911718:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578959.911727:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.911739:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789578959.911744:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789578959.912111:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789578959.913477:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578959.913494:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.913508:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789578959.913519:0:6487:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789578959.913523:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940679b000 from 7 10000000:01000000:2.0:1789578959.913526:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789578959.913572:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.913580:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.913592:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578959.913630:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789578959.913715:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578959.913770:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff93940844a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789578959.914103:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136768 00000100:00100000:1.0:1789578959.914114:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136768 00000100:00100000:1.0:1789578959.914193:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789578959.914203:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:6487:x1876509277136768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578959.914219:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578959.914237:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518400/0xd90373d592f20fd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f20fcf expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.914266:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518400/0xd90373d592f20fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f20fcf expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.914279:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518400/0xd90373d592f20fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f20fcf expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578959.914290:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:1.0:1789578959.914368:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277136768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578959.914376:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789578959.914544:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789578959.914562:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578959.914572:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578959.914654:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578959.914688:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.914721:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec840 going to sleep for 11 seconds 00000100:00100000:1.0:1789578959.916672:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277136896 00000100:00100000:1.0:1789578959.916692:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277136896 00000100:00100000:1.0:1789578959.916776:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789578959.916805:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277136896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.917132:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277136896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578959.917140:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789578959.917211:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277136896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.917277:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277137024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.917334:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578959.917383:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578959.917401:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137024 00000100:00100000:1.0:1789578959.917405:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137024 00000100:00100000:1.0:1789578959.917426:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789578959.917433:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277137024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.917520:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:6487:x1876509277137024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578959.917526:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789578959.917568:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42b2619d-9ae6-4775-a880-4d874c1635bc:6487:1876509277137024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789578959.917783:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13772:1876509277137152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789578959.917819:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578959.917839:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137152 00000100:00100000:1.0:1789578959.917843:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137152 00000100:00100000:1.0:1789578959.917859:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789578959.917864:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13772:x1876509277137152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.919192:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578959.921388:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13772:x1876509277137152:12345-0@lo:502:llog_process_th.0 Request processed in 3509us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578959.921429:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789578959.921890:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13772:1876509277137152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578959.921950:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578959.921964:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.921967:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789578959.921975:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940679b000 00000020:00000080:3.0:1789578959.921978:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789578959.922076:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578959.922080:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.922081:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789578959.922084:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789578959.922087:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.922089:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789578959.922093:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940679b000 00000020:00000080:3.0:1789578959.922095:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789578959.922169:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13772:1876509277137280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789578959.922233:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578959.922287:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303becd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789578959.922635:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137280 00000100:00100000:2.0:1789578959.922646:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137280 00000100:00100000:2.0:1789578959.922709:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789578959.922722:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13772:x1876509277137280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789578959.922889:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:13772:x1876509277137280:12345-0@lo:502:llog_process_th.0 Request processed in 169us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578959.922897:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789578959.925243:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42b2619d-9ae6-4775-a880-4d874c1635bc:13772:1876509277137280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789578959.925305:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789578959.925317:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789578959.925320:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789578959.925325:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789578959.925632:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789578959.925665:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789578959.925680:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578959.925695:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789578959.950096:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789578960.040273:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578960.119615:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578960.120092:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327232 00000100:00100000:1.0:1789578960.120109:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327232 00000100:00100000:1.0:1789578960.121871:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 357 00000100:00100000:1.0:1789578960.121904:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:6165:x1876509261327232:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578960.121928:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578960.121954:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401518c00/0xd90373d592f20fdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebec7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.121993:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401518c00/0xd90373d592f20fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec7 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.122007:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401518c00/0xd90373d592f20fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec7 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.122017:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518c00, rc 0) 00000100:00100000:1.0:1789578960.122591:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327232:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 698us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.122602:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 357 00000100:00100000:0.0:1789578960.127086:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578960.127168:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327360 00000100:00100000:3.0:1789578960.127178:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327360 00000100:00100000:3.0:1789578960.127241:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 358 00000100:00100000:3.0:1789578960.127251:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327360:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578960.127434:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327360:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.127443:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 358 00000100:00100000:2.0:1789578960.142740:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578960.142801:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327488 00000100:00100000:0.0:1789578960.142809:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327488 00000100:00100000:0.0:1789578960.142853:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 359 00000100:00100000:0.0:1789578960.142861:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327488:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578960.148671:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327488:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 5798us (5927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.148686:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 359 00000100:00100000:2.0:1789578960.158192:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578960.158382:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327616 00000100:00100000:3.0:1789578960.158392:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327616 00000100:00100000:3.0:1789578960.158451:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 360 00000100:00100000:3.0:1789578960.158462:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:10770:x1876509261327616:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789578960.158627:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:10770:x1876509261327616:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 165us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.158635:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 360 00000100:00100000:3.0:1789578960.171130:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578960.175097:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327744 00000100:00100000:0.0:1789578960.175113:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327744 00000100:00100000:0.0:1789578960.175183:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 361 00000100:00100000:0.0:1789578960.175193:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:10770:x1876509261327744:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789578960.175446:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:10770:x1876509261327744:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 253us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.175455:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 361 00000100:00100000:0.0:1789578960.189813:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578960.189916:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261327872 00000100:00100000:1.0:1789578960.189926:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261327872 00000100:00100000:1.0:1789578960.189981:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 362 00000100:00100000:1.0:1789578960.189991:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:6165:x1876509261327872:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789578960.190008:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578960.190028:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519a00/0xd90373d592f20fe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.190085:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519a00/0xd90373d592f20fe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebece expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.190097:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519a00/0xd90373d592f20fe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebece expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578960.190107:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519a00, rc 0) 00000100:00100000:1.0:1789578960.190164:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261327872:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 174us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.190171:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 362 00000100:00100000:2.0:1789578960.208874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578960.208961:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328000 00000100:00100000:3.0:1789578960.208971:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328000 00000100:00100000:3.0:1789578960.209027:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 363 00000100:00100000:3.0:1789578960.209048:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261328000:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789578960.209486:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261328000:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 448us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.209494:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 363 00000100:00100000:3.0:1789578960.214999:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578960.215417:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328128 00000100:00100000:0.0:1789578960.215440:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328128 00000100:00100000:0.0:1789578960.215547:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 364 00000100:00100000:0.0:1789578960.215557:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261328128:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789578960.215700:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:6165:x1876509261328128:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 143us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.215708:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 364 00000100:00100000:2.0:1789578960.220048:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578960.226556:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328256 00000100:00100000:1.0:1789578960.226724:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328256 00000100:00100000:1.0:1789578960.226792:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 365 00000100:00100000:1.0:1789578960.226803:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:10774:x1876509261328256:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789578960.226957:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:10774:x1876509261328256:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 155us (6927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.226964:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 365 00000100:00100000:1.0:1789578960.227985:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277137408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578960.228048:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578960.228129:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137408 00000100:00100000:1.0:1789578960.228134:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137408 00000100:00100000:1.0:1789578960.228176:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789578960.228183:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277137408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578960.228208:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578960.228887:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277137408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 701us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.228907:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789578960.229092:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789578960.229133:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277137408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578960.229553:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277137792:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.229609:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.229650:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277138304:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.229673:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.229692:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277138816:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.229709:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.229735:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789578960.229741:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277137664:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.229761:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.229984:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277138176:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.230008:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.230023:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277138688:0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.230055:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578960.230089:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137792 00000100:00100000:2.0:1789578960.230095:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137792 00000100:00100000:2.0:1789578960.230129:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138176 00000100:00100000:2.0:1789578960.230132:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138176 00000100:00100000:2.0:1789578960.230157:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789578960.230164:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277137792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.230206:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277137792:12345-0@lo:400:kworker.0 Request processed in 42us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578960.230213:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789578960.230824:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138304 00000100:00100000:1.0:1789578960.230830:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138304 00000100:00100000:1.0:1789578960.230859:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138816 00000100:00100000:1.0:1789578960.230862:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138816 00000100:00100000:1.0:1789578960.230873:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138688 00000100:00100000:1.0:1789578960.230875:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138688 00000100:00100000:1.0:1789578960.230889:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578960.230895:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277138304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.230934:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277138304:12345-0@lo:400:kworker.0 Request processed in 39us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.230941:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789578960.230953:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578960.230958:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277138816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.230983:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277138816:12345-0@lo:400:kworker.0 Request processed in 25us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.230989:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789578960.230998:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789578960.231003:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277138688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.231026:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277138688:12345-0@lo:400:kworker.0 Request processed in 22us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.231031:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789578960.231136:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231168:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578960.231189:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277138432:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231208:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578960.231223:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277138944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578960.231266:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578960.231288:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789578960.231294:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277137536:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231314:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578960.231325:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277138048:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231342:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578960.231372:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277138560:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231393:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789578960.231424:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789578960.231428:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578960.231430:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789578960.231443:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137664 00000100:00100000:0.0:1789578960.231447:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137664 00000100:00100000:0.0:1789578960.231471:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137920 00000100:00100000:0.0:1789578960.231473:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137920 00000100:00100000:0.0:1789578960.231500:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789578960.231506:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231552:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277137664:12345-0@lo:400:kworker.0 Request processed in 46us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.231559:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789578960.231586:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789578960.231592:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231621:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277137920:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.231627:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789578960.231656:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277137920:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.231716:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138432 00000100:00100000:0.0:1789578960.231719:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138432 00000100:00100000:2.0:1789578960.232015:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789578960.232026:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277138176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578960.232074:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277138176:12345-0@lo:400:kworker.0 Request processed in 50us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.236167:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138944 00000100:00100000:3.0:1789578960.236177:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138944 00000100:00100000:3.0:1789578960.236222:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789578960.236245:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277138944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789578960.236277:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578960.236343:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277138944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.236366:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789578960.236775:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277139200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578960.236817:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578960.236886:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277137536 00000100:00100000:1.0:1789578960.236890:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277137536 00000100:00100000:1.0:1789578960.236909:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138048 00000100:00100000:1.0:1789578960.236912:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138048 00000100:00100000:1.0:1789578960.236925:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277138560 00000100:00100000:1.0:1789578960.236928:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277138560 00000100:00100000:1.0:1789578960.236943:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789578960.236949:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277137536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.236983:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277137536:12345-0@lo:400:kworker.0 Request processed in 34us (5668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.236990:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789578960.237002:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789578960.237008:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277138048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.237045:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277138048:12345-0@lo:400:kworker.0 Request processed in 25us (5689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.237052:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789578960.237063:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789578960.237070:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277138560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.237111:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277138560:12345-0@lo:400:kworker.0 Request processed in 42us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578960.237118:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789578960.237384:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139200 00000100:00100000:3.0:1789578960.237389:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139200 00000100:00100000:3.0:1789578960.237413:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789578960.237419:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277139200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789578960.237437:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578960.237473:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277139200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.237479:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1789578960.237511:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5d500 x1876509277139200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578960.237543:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277139200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578960.240668:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277137664:0@lo:400:kworker.0 00010000:00080000:1.0:1789578960.240688:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8e00 x1876509277138176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578960.240699:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277138176:0@lo:400:kworker.0 00010000:00080000:1.0:1789578960.240710:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e5880 x1876509277138688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578960.240735:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277138688:0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.240752:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277137792:0@lo:400:kworker.0 00000100:00100000:1.0:1789578960.240778:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277138304:0@lo:400:kworker.0 00010000:00080000:1.0:1789578960.240791:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e4700 x1876509277138816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578960.240799:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277138816:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.241922:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789578960.241942:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.242021:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277138432:12345-0@lo:400:kworker.0 Request processed in 87us (10811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.242029:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789578960.242074:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277139072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578960.242110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789578960.242160:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578960.242165:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578960.242189:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277137536:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.242202:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277138048:0@lo:400:kworker.0 00010000:00080000:0.0:1789578960.242214:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b32680 x1876509277138560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578960.242234:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277138560:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.242248:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277138432:0@lo:400:kworker.0 00000100:00100000:0.0:1789578960.242346:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277138944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578960.242451:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578960.242534:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139072 00000100:00100000:3.0:1789578960.242541:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139072 00000100:00100000:3.0:1789578960.242600:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789578960.242608:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277139072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789578960.242624:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578960.242663:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277139072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578960.242669:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789578960.242695:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304239880 x1876509277139072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578960.242708:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277139072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578960.242940:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328384 00000100:00100000:0.0:1789578960.242945:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328384 00000100:00100000:0.0:1789578960.242982:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 366 00000100:00100000:0.0:1789578960.242989:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:10774:x1876509261328384:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789578960.243107:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:10774:x1876509261328384:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 117us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578960.243115:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 366 00000100:00100000:2.0:1789578960.250026:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000040:00080000:3.0:1789578960.932249:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789578960.996039:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789578961.059652:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578961.252148:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277139328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578961.252218:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578961.252472:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139328 00000100:00100000:2.0:1789578961.252480:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139328 00000100:00100000:2.0:1789578961.252538:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789578961.252548:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277139328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789578961.252587:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578961.252643:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277139328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578961.252651:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789578961.252786:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277139328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578961.253477:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789578961.253489:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277139456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578961.253532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578961.254570:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139456 00000100:00100000:0.0:1789578961.254579:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139456 00000100:00100000:0.0:1789578961.254633:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789578961.254642:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277139456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578961.254670:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578961.254729:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277139456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578961.254736:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789578961.254890:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277139456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789578962.084763:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578963.107992:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789578963.822251:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1789578964.131816:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578964.598431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578964.598488:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578964.598519:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578964.598549:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578964.598571:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578964.598613:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578964.598616:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328512 00000100:00100000:0.0:1789578964.598629:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328512 00000100:00100000:2.0:1789578964.598641:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328768 00000100:00100000:2.0:1789578964.598647:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328768 00000100:00080000:0.0:1789578964.598686:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578964.598692:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329024 00000100:00100000:2.0:1789578964.598696:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329024 00000100:00100000:0.0:1789578964.598715:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 367 00000100:00100000:2.0:1789578964.598719:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328640 00000100:00100000:2.0:1789578964.598722:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328640 00000100:00100000:2.0:1789578964.598737:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329152 00000100:00100000:2.0:1789578964.598743:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329152 00000100:00100000:0.0:1789578964.598744:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261328512:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578964.598763:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:2.0:1789578964.598771:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328768:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578964.598821:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261328512:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 83us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578964.598829:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 367 00000100:00100000:1.0:1789578964.598855:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 218 00000100:00100000:1.0:1789578964.598866:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261329024:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578964.598989:0:6491:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789578964.599021:0:6491:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1789578964.599060:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578964.605058:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328768:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 6274us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578964.605074:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:2.0:1789578964.605134:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:2.0:1789578964.605147:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328640:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578964.605210:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328640:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 68us (6660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578964.605216:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:2.0:1789578964.605229:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:2.0:1789578964.605236:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261329152:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578964.605260:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261329152:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (6648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578964.605266:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:2.0:1789578964.605422:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261328896 00000100:00100000:2.0:1789578964.605430:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261328896 00000100:00100000:2.0:1789578964.605500:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:2.0:1789578964.605509:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328896:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:3.0:1789578964.605519:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578964.605542:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261328896:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 33us (6969us total) trans 0 rc 0/0 00000100:00080000:3.0:1789578964.605547:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578964.605565:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789578964.608580:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261329024:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 9705us (10049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578964.608600:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 218 00010000:00010000:2.0:1789578965.156052:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578965.347714:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277139712:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.347718:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277139968:0@lo:400:kworker.0 00000100:00100000:3.0:1789578965.347906:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277139840:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.347952:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277139584:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.348121:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.349655:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277140480:0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.349665:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578965.349727:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277140224:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.349813:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.349843:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277140992:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.349868:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.349899:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277141504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578965.349923:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.349963:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140480 00000100:00100000:0.0:1789578965.349972:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140480 00000100:00100000:2.0:1789578965.349989:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578965.350026:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277140736:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.350041:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140992 00000100:00100000:0.0:1789578965.350047:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140992 00000100:00100000:2.0:1789578965.350052:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.350075:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789578965.350088:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277140480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.350099:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277141248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578965.350124:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578965.350146:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578965.350153:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277141376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578965.350159:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277140480:12345-0@lo:400:kworker.0 Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578965.350168:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789578965.350186:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.350202:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789578965.350218:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141504 00000100:00100000:2.0:1789578965.350223:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141504 00000100:00100000:2.0:1789578965.350248:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141248 00000100:00100000:2.0:1789578965.350250:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141248 00000100:00100000:2.0:1789578965.350264:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141376 00000100:00100000:2.0:1789578965.350266:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141376 00000100:00100000:2.0:1789578965.350296:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578965.350302:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876509277141504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789578965.350325:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578965.350375:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876509277141504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.350380:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789578965.350393:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789578965.350398:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277141248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578965.350423:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578965.350452:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277141248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.350457:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789578965.350468:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789578965.350634:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277141376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578965.350645:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578965.350671:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277141376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.350683:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789578965.350774:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139968 00000100:00100000:2.0:1789578965.350779:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139968 00000100:00100000:2.0:1789578965.350807:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139712 00000100:00100000:2.0:1789578965.350810:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139712 00000100:00100000:2.0:1789578965.350820:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140224 00000100:00100000:2.0:1789578965.350822:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140224 00000100:00100000:2.0:1789578965.350900:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140736 00000100:00100000:2.0:1789578965.350906:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140736 00000100:00100000:2.0:1789578965.350928:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789578965.350934:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277139968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.350970:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277139968:12345-0@lo:400:kworker.0 Request processed in 35us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.350975:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789578965.350988:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789578965.351006:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277139712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.351032:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277139712:12345-0@lo:400:kworker.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.351038:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789578965.351048:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789578965.351053:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277140224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.351073:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277140224:12345-0@lo:400:kworker.0 Request processed in 21us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.351078:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789578965.351086:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789578965.351091:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277140736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.351127:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277140736:12345-0@lo:400:kworker.0 Request processed in 35us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.351132:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789578965.351853:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277140992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.351898:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277141376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578965.351908:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277140992:12345-0@lo:400:kworker.0 Request processed in 62us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.351913:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789578965.351918:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939304239c00, transno 4294967301 00000100:00100000:0.0:1789578965.351931:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789578965.351943:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277141248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578965.351957:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277139712:0@lo:400:kworker.0 00000100:00080000:0.0:1789578965.351970:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578965.351971:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277140224:0@lo:400:kworker.0 00000100:00080000:0.0:1789578965.351979:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789578965.351985:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578965.351986:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277140736:0@lo:400:kworker.0 00010000:00080000:0.0:1789578965.352040:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b32680 x1876509277141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578965.352058:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277141504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789578965.352073:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277139968:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.352086:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277140480:0@lo:400:kworker.0 00010000:00080000:0.0:1789578965.352095:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b6300 x1876509277140992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578965.352104:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277140992:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.352221:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789578965.352318:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277141632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578965.352386:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578965.352693:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141632 00000100:00100000:2.0:1789578965.352761:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141632 00000100:00100000:2.0:1789578965.352809:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789578965.352815:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277141632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578965.352829:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578965.352877:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277141632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.352884:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789578965.353008:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789578965.353035:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b5500 x1876509277141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578965.353051:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277141632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578965.355838:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578965.355862:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578965.355945:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277140096:0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.356027:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139584 00000100:00100000:2.0:1789578965.356036:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139584 00000100:00100000:2.0:1789578965.356087:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789578965.356097:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277139584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.356150:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402dc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277139584:12345-0@lo:400:kworker.0 Request processed in 55us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.356777:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789578965.357573:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277140352:0@lo:400:kworker.0 00000100:00100000:3.0:1789578965.357647:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578965.357680:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277140864:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.357690:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578965.357710:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578965.357761:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140352 00000100:00100000:3.0:1789578965.357766:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140864 00000100:00100000:2.0:1789578965.357772:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140352 00000100:00100000:3.0:1789578965.357794:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140864 00000100:00100000:2.0:1789578965.357846:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789578965.357864:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277140352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578965.357870:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789578965.357887:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277140864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.357954:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277140352:12345-0@lo:400:kworker.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578965.357968:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789578965.357969:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277140864:12345-0@lo:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578965.357982:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:3.0:1789578965.358048:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b5f80 x1876509277140864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789578965.358062:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578965.358067:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277140864:0@lo:400:kworker.0 00010000:00080000:3.0:1789578965.358117:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b5180 x1876509277140352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578965.358126:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277140352:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.363390:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277140608:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.363464:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578965.366239:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277139840 00000100:00100000:0.0:1789578965.366259:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277139840 00000100:00100000:0.0:1789578965.366343:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140096 00000100:00100000:0.0:1789578965.366346:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140096 00000100:00100000:0.0:1789578965.368274:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789578965.368295:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277141120:0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.368318:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277139840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.368380:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578965.368426:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277139584:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.368463:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277140608 00000100:00100000:1.0:1789578965.368469:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277140608 00000100:00100000:1.0:1789578965.368508:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141120 00000100:00100000:1.0:1789578965.368511:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141120 00000100:00100000:1.0:1789578965.368538:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789578965.368548:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277140608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578965.368589:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277139840:12345-0@lo:400:kworker.0 Request processed in 278us (12760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578965.368600:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789578965.368618:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277140608:12345-0@lo:400:kworker.0 Request processed in 68us (5149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578965.368630:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789578965.368634:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789578965.368651:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277140096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.368658:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789578965.368670:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277141120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578965.374897:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277139840:0@lo:400:kworker.0 00000100:00100000:1.0:1789578965.375297:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277141120:12345-0@lo:400:kworker.0 Request processed in 6620us (6908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578965.375311:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789578965.376642:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277140096:12345-0@lo:400:kworker.0 Request processed in 7988us (18944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578965.376659:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789578965.378473:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277140096:0@lo:400:kworker.0 00000100:00100000:2.0:1789578965.378501:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277140608:0@lo:400:kworker.0 00010000:00080000:2.0:1789578965.378518:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b7100 x1876509277141120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578965.378530:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277141120:0@lo:400:kworker.0 00010000:00010000:2.0:1789578966.179671:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578966.371762:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578966.371795:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277141760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578966.371877:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578966.372039:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141760 00000100:00100000:0.0:1789578966.372058:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141760 00000100:00100000:0.0:1789578966.372145:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789578966.372158:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277141760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578966.372215:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578966.372295:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277141760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578966.372303:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789578966.372640:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277141888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578966.372683:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578966.372739:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277141760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789578966.373921:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277141888 00000100:00100000:1.0:1789578966.373936:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277141888 00000100:00100000:1.0:1789578966.374020:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789578966.374032:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277141888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578966.374078:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789578966.374185:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277141888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578966.374194:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789578966.374253:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277141888:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789578967.206686:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578968.228833:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578969.253273:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578969.720042:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578969.720088:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578969.720124:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578969.720162:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578969.720181:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578969.720202:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578969.720288:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329408 00000100:00100000:2.0:1789578969.720299:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329408 00000100:00100000:2.0:1789578969.720404:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329920 00000100:00100000:2.0:1789578969.720408:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329920 00000100:00100000:2.0:1789578969.720429:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329536 00000100:00100000:2.0:1789578969.720431:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329536 00000100:00100000:1.0:1789578969.720444:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329792 00000100:00100000:1.0:1789578969.720451:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329792 00000100:00100000:2.0:1789578969.720456:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:2.0:1789578969.720467:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329408:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578969.720485:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:1.0:1789578969.720495:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261329920:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578969.720572:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329408:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 107us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578969.720594:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:2.0:1789578969.720613:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:2.0:1789578969.720621:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329536:12345-192.168.203.37@tcp:400:kworker.0 00000100:00080000:0.0:1789578969.720672:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578969.720677:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578969.720699:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329280 00000100:00100000:0.0:1789578969.720703:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329280 00000100:00100000:0.0:1789578969.720739:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 369 00000100:00100000:0.0:1789578969.720745:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261329280:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578969.720814:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 230 00000100:00100000:3.0:1789578969.720822:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261329792:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578969.726781:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261329920:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 6275us (6643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578969.726795:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:1.0:1789578969.727717:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261329664 00000100:00100000:1.0:1789578969.727727:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261329664 00000100:00100000:1.0:1789578969.727798:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:1.0:1789578969.727808:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329664:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578969.727868:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329664:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 62us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578969.727876:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00080000:1.0:1789578969.727925:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578969.734102:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261329536:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 13467us (13904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578969.734118:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:0.0:1789578969.737116:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261329280:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 16357us (16940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578969.737131:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 369 00000100:00100000:3.0:1789578969.737980:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261329792:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 17153us (17770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578969.738003:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 230 00000040:00080000:3.0:1789578970.148182:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789578970.212150:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789578970.276042:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578970.467614:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578970.467639:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277142016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578970.467705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578970.467985:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142016 00000100:00100000:0.0:1789578970.467992:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142016 00000100:00100000:0.0:1789578970.468332:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789578970.468344:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277142016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578970.468392:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578970.468436:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277142016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578970.468443:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789578970.468549:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578970.468912:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277142272:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.468946:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.468986:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277142784:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.469007:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469023:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277143296:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.469056:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469079:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277143808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578970.469100:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469117:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789578970.469123:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277142400:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.469156:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469172:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277142912:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.469193:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469221:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277143424:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.469244:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578970.469279:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143808 00000100:00100000:2.0:1789578970.469283:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143808 00000100:00100000:2.0:1789578970.469312:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789578970.469320:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277143808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578970.469340:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578970.469395:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277143808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578970.469401:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789578970.470244:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142272 00000100:00100000:2.0:1789578970.470252:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142272 00000100:00100000:2.0:1789578970.470287:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142784 00000100:00100000:2.0:1789578970.470290:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142784 00000100:00100000:2.0:1789578970.470302:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143296 00000100:00100000:2.0:1789578970.470304:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143296 00000100:00100000:2.0:1789578970.470315:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142912 00000100:00100000:2.0:1789578970.470317:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142912 00000100:00100000:2.0:1789578970.470332:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789578970.470338:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277142272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.470415:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277142272:12345-0@lo:400:kworker.0 Request processed in 77us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578970.470421:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789578970.470434:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789578970.471321:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789578970.471333:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277143296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471411:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277143296:12345-0@lo:400:kworker.0 Request processed in 82us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.471428:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789578970.471445:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789578970.471460:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471485:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277142912:12345-0@lo:400:kworker.0 Request processed in 35us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.471505:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789578970.471546:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143424 00000100:00100000:1.0:1789578970.471552:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143424 00000100:00100000:1.0:1789578970.471586:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789578970.471592:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471623:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277143424:12345-0@lo:400:kworker.0 Request processed in 31us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.471628:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789578970.471656:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277142144:0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471690:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578970.471723:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277142656:0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471746:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578970.471763:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277143168:0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.471780:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578970.471792:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578970.471812:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578970.472145:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277142528:0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.472174:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578970.472196:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277143040:0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.472218:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578970.472236:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277143552:0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.472299:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578970.472333:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277143936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578970.472412:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578970.472436:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142400 00000100:00100000:3.0:1789578970.472441:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142400 00000100:00100000:2.0:1789578970.473362:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277142784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.473416:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277142784:12345-0@lo:400:kworker.0 Request processed in 2976us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578970.473424:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789578970.473599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142656 00000100:00100000:3.0:1789578970.473605:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142656 00000100:00100000:3.0:1789578970.473620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789578970.473626:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277142400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.473661:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277142400:12345-0@lo:400:kworker.0 Request processed in 34us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578970.473667:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789578970.473680:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789578970.473685:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.473712:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277142656:12345-0@lo:400:kworker.0 Request processed in 27us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578970.473718:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789578970.473741:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143168 00000100:00100000:3.0:1789578970.473750:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143168 00000100:00100000:0.0:1789578970.473829:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142528 00000100:00100000:0.0:1789578970.473834:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142528 00000100:00100000:3.0:1789578970.473955:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789578970.473974:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277143168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.474004:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277143168:12345-0@lo:400:kworker.0 Request processed in 33us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578970.474009:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789578970.478306:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789578970.478330:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277142528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.480162:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277142016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578970.480290:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143040 00000100:00100000:3.0:1789578970.480298:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143040 00000100:00100000:3.0:1789578970.480344:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143552 00000100:00100000:3.0:1789578970.480348:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143552 00000100:00100000:3.0:1789578970.480384:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578970.480393:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277143040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578970.480863:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277142528:12345-0@lo:400:kworker.0 Request processed in 2543us (8684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578970.480872:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789578970.480900:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143680 00000100:00100000:0.0:1789578970.480904:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143680 00000100:00100000:0.0:1789578970.480923:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277143936 00000100:00100000:0.0:1789578970.480925:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277143936 00000100:00100000:0.0:1789578970.480938:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789578970.480944:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277143680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578970.480986:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578970.483685:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277142656:0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.483704:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277143168:0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.483745:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277142144 00000100:00100000:1.0:1789578970.483750:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277142144 00000100:00100000:1.0:1789578970.483799:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789578970.483817:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277142144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.485227:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277142144:12345-0@lo:400:kworker.0 Request processed in 1408us (13534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.485237:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789578970.485298:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789578970.485308:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277143552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578970.485345:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277143552:12345-0@lo:400:kworker.0 Request processed in 40us (13045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.485365:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789578970.485394:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789578970.485402:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277143936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578970.485538:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578970.485584:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277143936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (13171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578970.485590:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789578970.485639:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277143936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789578970.485753:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277142144:0@lo:400:kworker.0 00000100:00080000:1.0:1789578970.485793:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789578970.485798:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578970.486118:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277143040:12345-0@lo:400:kworker.0 Request processed in 5725us (13897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578970.486126:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789578970.486212:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277142528:0@lo:400:kworker.0 00000100:00100000:3.0:1789578970.486222:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277143040:0@lo:400:kworker.0 00010000:00080000:3.0:1789578970.486235:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa6a00 x1876509277143552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578970.486246:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277143552:0@lo:400:kworker.0 00000100:00080000:1.0:1789578970.486549:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578970.486552:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578970.486685:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277143680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5740us (14870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578970.486693:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1789578970.487599:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa4a80 x1876509277143680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578970.487618:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578970.491586:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277142400:0@lo:400:kworker.0 00010000:00080000:2.0:1789578970.491611:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa7b80 x1876509277142912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578970.491621:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277142912:0@lo:400:kworker.0 00010000:00080000:2.0:1789578970.491634:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa5180 x1876509277143424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578970.491643:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277143424:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.491654:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277142272:0@lo:400:kworker.0 00000100:00100000:2.0:1789578970.491666:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277142784:0@lo:400:kworker.0 00010000:00080000:2.0:1789578970.491676:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa6680 x1876509277143296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578970.491683:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277143296:0@lo:400:kworker.0 00010000:00080000:2.0:1789578970.491694:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b4e00 x1876509277143808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578970.491711:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277143808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789578971.301873:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578971.491704:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789578971.491726:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277144064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578971.491789:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578971.491896:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144064 00000100:00100000:0.0:1789578971.491905:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144064 00000100:00100000:0.0:1789578971.491961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789578971.491971:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277144064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578971.492002:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578971.492046:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277144064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578971.492053:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789578971.492133:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277144064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578971.492250:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277144192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578971.492272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578971.492347:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144192 00000100:00100000:0.0:1789578971.492370:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144192 00000100:00100000:0.0:1789578971.492398:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789578971.492404:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277144192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578971.492420:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789578971.492456:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277144192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578971.492462:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789578971.492522:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277144192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789578972.324561:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578973.347635:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578974.371584:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578974.844520:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578974.844567:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578974.844595:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578974.844679:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330048 00000100:00100000:0.0:1789578974.844693:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330048 00000100:00100000:0.0:1789578974.844748:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 371 00000100:00100000:0.0:1789578974.844758:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261330048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578974.844827:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940621f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261330048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578974.844851:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 371 00000100:00100000:0.0:1789578974.844908:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330304 00000100:00100000:0.0:1789578974.844912:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330304 00000100:00100000:0.0:1789578974.844949:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330176 00000100:00100000:0.0:1789578974.844953:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330176 00000100:00100000:0.0:1789578974.844976:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:0.0:1789578974.844984:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578974.844989:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00100000:2.0:1789578974.844997:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330176:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578974.845020:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330176:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578974.845020:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578974.845026:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00080000:1.0:1789578974.845066:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578974.845070:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789578974.846065:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:1.0:1789578974.862201:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578974.862316:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330432 00000100:00100000:2.0:1789578974.862326:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330432 00000100:00100000:2.0:1789578974.862722:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789578974.862733:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261330432:12345-192.168.203.37@tcp:9:kworker.0 00000020:00000080:2.0:1789578974.862766:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20f0b 00000100:00080000:2.0:1789578974.862776:0:8405:0:(import.c:65:import_set_state_nolock()) ffff93930206a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789578974.862827:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1789578974.862994:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+2:2391:x1876509261330432:12345-192.168.203.37@tcp:9:kworker.0 Request processed in 262us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578974.863001:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00080000:1.0:1789578974.863052:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789578974.864286:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578974.869680:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578974.869828:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578974.880166:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330560 00000100:00100000:2.0:1789578974.880190:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330560 00000100:00100000:2.0:1789578974.880341:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330688 00000100:00100000:2.0:1789578974.880346:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330688 00000100:00100000:0.0:1789578974.880418:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00100000:0.0:1789578974.880431:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261330560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578974.880509:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261330560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 82us (10839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578974.880516:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00080000:1.0:1789578974.881476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789578974.881482:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578974.884805:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 240 00000100:00100000:2.0:1789578974.884819:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261330688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578974.884922:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261330688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 105us (15093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578974.884938:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 240 00010000:00010000:2.0:1789578975.402626:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578975.587673:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277144704:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.587753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.587807:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277145216:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.587831:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.587854:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277145728:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.587873:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.587906:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789578975.587911:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277144576:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.587960:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.587981:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277145088:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588002:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588018:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277145600:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588037:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588066:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144576 00000100:00100000:0.0:1789578975.588073:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144576 00000100:00100000:0.0:1789578975.588125:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789578975.588134:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277144576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588183:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277144576:12345-0@lo:400:kworker.0 Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.588190:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789578975.588217:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144704 00000100:00100000:0.0:1789578975.588220:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144704 00000100:00100000:0.0:1789578975.588242:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145088 00000100:00100000:0.0:1789578975.588244:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145088 00000100:00100000:0.0:1789578975.588267:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145600 00000100:00100000:0.0:1789578975.588284:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145600 00000100:00100000:0.0:1789578975.588301:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789578975.588308:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277144704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588339:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277144704:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.588344:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789578975.588379:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789578975.588386:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277145088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588424:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277145088:12345-0@lo:400:kworker.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.588430:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789578975.588443:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789578975.588449:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277145600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588475:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277145600:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.588481:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789578975.588517:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277144576:0@lo:400:kworker.0 00010000:00080000:0.0:1789578975.588532:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa5180 x1876509277145088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578975.588544:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277145088:0@lo:400:kworker.0 00010000:00080000:0.0:1789578975.588553:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa6a00 x1876509277145600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578975.588563:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277145600:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.588575:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277144320:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588576:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277144704:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.588619:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578975.588651:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277144832:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588657:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144320 00000100:00100000:0.0:1789578975.588662:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144320 00000100:00100000:2.0:1789578975.588690:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588694:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789578975.588704:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277144320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.588717:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145344:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588744:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277144320:12345-0@lo:400:kworker.0 Request processed in 41us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.588754:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789578975.588755:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578975.588777:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145856:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.588803:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588806:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144832 00000100:00100000:0.0:1789578975.588811:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144832 00000100:00100000:2.0:1789578975.588834:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277144320:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588841:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789578975.588845:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789578975.588851:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277144832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.588856:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277144448:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588897:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277144832:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.588898:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789578975.588943:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277144960:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.588952:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145216 00000100:00100000:0.0:1789578975.588957:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145216 00000100:00100000:0.0:1789578975.588980:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145728 00000100:00100000:2.0:1789578975.588981:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.588985:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145728 00000100:00100000:0.0:1789578975.589003:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145344 00000100:00100000:0.0:1789578975.589006:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145344 00000100:00100000:2.0:1789578975.589007:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277145472:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589022:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145856 00000100:00100000:0.0:1789578975.589025:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145856 00000100:00100000:2.0:1789578975.589040:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.589044:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789578975.589052:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277145216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589063:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578975.589097:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277145216:12345-0@lo:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.589101:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578975.589109:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789578975.589126:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789578975.589132:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277144832:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589136:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277145728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589168:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144448 00000100:00100000:0.0:1789578975.589173:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277145728:12345-0@lo:400:kworker.0 Request processed in 40us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.589175:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144448 00000100:00100000:0.0:1789578975.589183:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789578975.589197:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789578975.589202:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277144960 00000100:00100000:0.0:1789578975.589205:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589207:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277144960 00000100:00100000:2.0:1789578975.589228:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145472 00000100:00100000:2.0:1789578975.589238:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145472 00000100:00100000:0.0:1789578975.589244:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145344:12345-0@lo:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.589260:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789578975.589261:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789578975.589273:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277144448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589281:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789578975.589289:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589311:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277144448:12345-0@lo:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.589319:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789578975.589330:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145856:12345-0@lo:400:kworker.0 Request processed in 41us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.589336:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789578975.589339:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789578975.589347:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277144960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589394:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277145216:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589405:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277144960:12345-0@lo:400:kworker.0 Request processed in 59us (425us total) trans 0 rc 0/0 00010000:00080000:0.0:1789578975.589411:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa7800 x1876509277145728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578975.589422:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277145728:0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589442:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789578975.589449:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277145472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578975.589477:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277145472:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578975.589483:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789578975.589686:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789578975.589715:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277144448:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589724:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277144960:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589732:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277145472:0@lo:400:kworker.0 00000100:00100000:2.0:1789578975.589741:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145344:0@lo:400:kworker.0 00010000:00080000:2.0:1789578975.589750:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa4700 x1876509277145856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578975.589758:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145856:0@lo:400:kworker.0 00000100:00100000:1.0:1789578975.590124:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277145984 00000100:00100000:1.0:1789578975.590129:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277145984 00000100:00100000:1.0:1789578975.590160:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789578975.590167:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789578975.590188:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578975.590229:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277145984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578975.590234:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789578975.590260:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578975.590264:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789578975.590266:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789578975.590268:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578975.590406:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277146112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789578975.590438:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578975.590480:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146112 00000100:00100000:3.0:1789578975.590484:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146112 00000100:00100000:3.0:1789578975.590508:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578975.590514:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277146112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789578975.590542:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578975.590576:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277146112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578975.590582:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789578975.590615:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277146112:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789578975.591095:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f6b6a00 x1876509277145984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578975.591111:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277145984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789578975.591212:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277146240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789578975.591243:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578975.591875:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146240 00000100:00100000:2.0:1789578975.591882:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146240 00000100:00100000:2.0:1789578975.591940:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789578975.591947:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277146240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578975.591963:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578975.592008:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277146240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578975.592015:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789578975.592509:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277146240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578975.593967:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277146368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578975.594030:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578975.594118:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146368 00000100:00100000:3.0:1789578975.594126:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146368 00000100:00100000:3.0:1789578975.594174:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789578975.594184:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277146368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789578975.594202:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578975.599665:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277146368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5473us (5624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578975.599679:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1789578975.604421:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939408eaed80 x1876509277146368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578975.604448:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277146368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789578976.419649:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578976.611820:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277146496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789578976.611893:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578976.612397:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277146624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789578976.612457:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578976.616129:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146496 00000100:00100000:0.0:1789578976.616145:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146496 00000100:00100000:0.0:1789578976.616224:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146624 00000100:00100000:0.0:1789578976.616228:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146624 00000100:00100000:0.0:1789578976.616250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789578976.616259:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277146496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578976.616293:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789578976.616410:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789578976.616414:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277146496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578976.616437:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789578976.616483:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277146624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789578976.616506:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789578976.616559:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277146624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578976.616567:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789578976.616648:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277146496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578976.616789:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277146624:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789578977.444077:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578978.467705:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578979.491914:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578979.960315:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578979.960384:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578979.960427:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330944 00000100:00100000:0.0:1789578979.960428:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578979.960437:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330944 00000100:00100000:0.0:1789578979.960451:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578979.960472:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578979.960489:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331200 00000100:00100000:0.0:1789578979.960490:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261330816 00000100:00100000:0.0:1789578979.960494:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261330816 00000100:00100000:3.0:1789578979.960500:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331200 00000100:00100000:3.0:1789578979.960515:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331072 00000100:00100000:3.0:1789578979.960517:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331072 00000100:00100000:0.0:1789578979.960521:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 373 00000100:00100000:3.0:1789578979.960527:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331328 00000100:00100000:3.0:1789578979.960529:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331328 00000100:00100000:0.0:1789578979.960530:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261330816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578979.960541:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 247 00000100:00100000:3.0:1789578979.960546:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330944:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578979.960622:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 248 00000100:00100000:1.0:1789578979.960631:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261331200:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578979.960679:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261330816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 149us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578979.960687:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 373 00000100:00100000:0.0:1789578979.960736:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 249 00000100:00100000:0.0:1789578979.960744:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261331072:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578979.966111:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261330944:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 5552us (5795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578979.966126:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 247 00000100:00100000:3.0:1789578979.966173:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00100000:3.0:1789578979.966185:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261331328:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578979.966233:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261331328:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 52us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578979.966240:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00080000:3.0:1789578979.966262:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789578979.966267:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789578979.972114:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261331200:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 11473us (11717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578979.972130:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 248 00000100:00100000:0.0:1789578979.974559:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261331072:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 13804us (14095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578979.974576:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 249 00000040:00080000:1.0:1789578980.388002:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789578980.455068:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789578980.515631:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578980.707918:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277146880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578980.707980:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578980.708035:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578980.708040:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277147008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578980.708057:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.708532:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277147136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789578980.708559:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.708591:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578980.708596:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277146752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578980.708614:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.708635:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146880 00000100:00100000:1.0:1789578980.708641:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146880 00000100:00100000:1.0:1789578980.708695:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147008 00000100:00100000:1.0:1789578980.708698:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147008 00000100:00100000:1.0:1789578980.708708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147136 00000100:00100000:1.0:1789578980.708710:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147136 00000100:00100000:1.0:1789578980.708721:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277146752 00000100:00100000:1.0:1789578980.708723:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277146752 00000100:00100000:1.0:1789578980.708734:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789578980.708741:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277146880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789578980.708771:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578980.708815:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277146880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.708821:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789578980.708835:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789578980.708840:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277147008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789578980.708852:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578980.708872:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277147008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.708878:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789578980.708899:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789578980.708905:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277147136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789578980.708930:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578980.708956:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277147136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.708961:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789578980.708970:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789578980.708976:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277146752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789578980.708984:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789578980.709000:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277146752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.709005:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789578980.709040:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277146752:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789578980.709051:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f685f80 x1876509277147136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578980.709062:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277147136:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789578980.709089:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ab1500 x1876509277147008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789578996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578980.709099:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277147008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578980.709108:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277146880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789578980.709394:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789578980.709399:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789578980.711284:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277147520:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.711384:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578980.711431:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277148032:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.711459:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578980.711492:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789578980.711498:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277147392:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.711520:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578980.711537:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277147904:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.711556:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578980.711610:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147520 00000100:00100000:3.0:1789578980.711618:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147520 00000100:00100000:3.0:1789578980.711661:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789578980.711670:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277147520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.713867:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277147520:12345-0@lo:400:kworker.0 Request processed in 2192us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578980.713891:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789578980.713934:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148032 00000100:00100000:3.0:1789578980.713941:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148032 00000100:00100000:3.0:1789578980.713984:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147392 00000100:00100000:3.0:1789578980.713987:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147392 00000100:00100000:3.0:1789578980.714005:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147904 00000100:00100000:3.0:1789578980.714008:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147904 00000100:00100000:3.0:1789578980.714024:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789578980.714031:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277148032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.714067:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277148032:12345-0@lo:400:kworker.0 Request processed in 36us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578980.714072:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789578980.714085:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789578980.714090:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277147392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.714115:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277147392:12345-0@lo:400:kworker.0 Request processed in 26us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578980.714121:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789578980.714131:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789578980.714137:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277147904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.714162:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277147904:12345-0@lo:400:kworker.0 Request processed in 26us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578980.714178:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1789578980.714197:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578980.714201:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578980.715634:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277147392:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.715652:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277147904:0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.715664:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277147520:0@lo:400:kworker.0 00010000:00080000:3.0:1789578980.715677:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ab0000 x1876509277148032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789578980.716896:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277148032:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717045:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277147264:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717106:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.717143:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277147776:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717164:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.717203:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277148288:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717237:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.717258:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789578980.717264:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277147648:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717285:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578980.717302:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277148160:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.717319:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578980.717782:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147776 00000100:00100000:3.0:1789578980.717793:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147776 00000100:00100000:3.0:1789578980.717842:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789578980.717851:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277147776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578980.717917:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277147776:12345-0@lo:400:kworker.0 Request processed in 67us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578980.717924:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789578980.718034:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277147776:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.718058:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148288 00000100:00100000:1.0:1789578980.718061:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148288 00000100:00100000:1.0:1789578980.718092:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147648 00000100:00100000:1.0:1789578980.718095:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147648 00000100:00100000:1.0:1789578980.718109:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148160 00000100:00100000:1.0:1789578980.718111:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148160 00000100:00100000:1.0:1789578980.718126:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789578980.718131:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277148288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.718164:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277148288:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.718172:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789578980.718183:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789578980.718189:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277147648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.718214:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277147648:12345-0@lo:400:kworker.0 Request processed in 26us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.718232:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789578980.718243:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789578980.718249:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277148160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.718288:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277148160:12345-0@lo:400:kworker.0 Request processed in 39us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578980.718293:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789578980.718788:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277147648:0@lo:400:kworker.0 00000100:00100000:1.0:1789578980.718799:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277148160:0@lo:400:kworker.0 00010000:00080000:1.0:1789578980.718810:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ab3b80 x1876509277148288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789578996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578980.718818:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277148288:0@lo:400:kworker.0 00000100:00100000:0.0:1789578980.719377:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277147264 00000100:00100000:0.0:1789578980.719384:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277147264 00000100:00100000:0.0:1789578980.719757:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789578980.719766:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277147264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578980.719828:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277147264:12345-0@lo:400:kworker.0 Request processed in 64us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578980.719841:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789578980.719927:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277147264:0@lo:400:kworker.0 00000100:00080000:3.0:1789578980.720090:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789578980.720096:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1789578980.720178:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:0.0:1789578980.720183:0:8398:0:(genops.c:885:class_export_put()) final put ffff93930206c000/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:3.0:1789578980.720557:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206c000/28fc5077-c53d-437a-bade-84c159d25114 for lustre-OST0000 00000020:00000080:3.0:1789578980.720613:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930206a000 for lustre-OST0000 00010000:00010000:3.0:1789578981.541170:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578981.733624:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277148416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578981.733702:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578981.733769:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148416 00000100:00100000:0.0:1789578981.733776:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148416 00000100:00100000:0.0:1789578981.733902:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789578981.733913:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277148416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578981.733945:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578981.733996:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277148416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578981.734003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789578981.734061:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277148416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789578981.737051:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277148544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578981.737656:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578981.739335:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148544 00000100:00100000:1.0:1789578981.739346:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148544 00000100:00100000:1.0:1789578981.739421:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789578981.739432:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277148544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578981.739467:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789578981.739545:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277148544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578981.739552:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789578981.739603:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277148544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789578982.569017:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578983.588718:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578984.611618:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789578984.752144:0:14036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:16:22 (1789578982) 00000100:00100000:0.0:1789578985.080731:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578985.080771:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578985.080807:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578985.080839:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578985.080879:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578985.080910:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331584 00000100:00100000:0.0:1789578985.080932:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331584 00000100:00100000:0.0:1789578985.080991:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331840 00000100:00100000:0.0:1789578985.080994:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331840 00000100:00100000:0.0:1789578985.081020:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331712 00000100:00100000:0.0:1789578985.081023:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331712 00000100:00100000:0.0:1789578985.081036:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331968 00000100:00100000:0.0:1789578985.081038:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331968 00000100:00100000:0.0:1789578985.081053:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 257 00000100:00100000:0.0:1789578985.081061:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261331584:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578985.081129:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261331584:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 68us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.081137:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 257 00000100:00100000:0.0:1789578985.081153:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 258 00000100:00100000:0.0:1789578985.081160:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261331840:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578985.081195:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261331840:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 35us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.081202:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 258 00000100:00100000:0.0:1789578985.081213:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 259 00000100:00100000:0.0:1789578985.081219:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261331712:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578985.081241:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261331712:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.081247:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 259 00000100:00100000:0.0:1789578985.081258:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 260 00000100:00100000:0.0:1789578985.081264:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261331968:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578985.081284:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261331968:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.081299:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 260 00000100:00080000:0.0:1789578985.081319:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578985.081323:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578985.081947:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261331456 00000100:00100000:2.0:1789578985.081954:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261331456 00000100:00100000:2.0:1789578985.082304:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 375 00000100:00100000:2.0:1789578985.082313:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261331456:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578985.082395:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261331456:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 84us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578985.082402:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 375 00010000:00010000:2.0:1789578985.636041:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578985.827581:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277148672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578985.827663:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578985.827733:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578985.827741:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277148800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578985.827781:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148672 00000100:00100000:3.0:1789578985.827804:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148672 00000100:00100000:3.0:1789578985.827902:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789578985.827916:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277148672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789578985.827976:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578985.828064:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277148672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578985.828073:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789578985.828119:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277148928:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789578985.828164:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578985.828165:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578985.828199:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148928 00000100:00100000:3.0:1789578985.828205:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148928 00000100:00100000:3.0:1789578985.828242:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789578985.828268:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277148928:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789578985.828302:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789578985.828375:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ac2680 x1876509277148672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578985.828420:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277148672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578985.828555:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277148800 00000100:00100000:0.0:1789578985.828562:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277148800 00000100:00100000:0.0:1789578985.828615:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789578985.828624:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277148800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789578985.828653:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789578985.828704:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578985.828707:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277148800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.828718:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789578985.828766:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277148928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 515us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578985.828777:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789578985.828808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578985.828817:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277148928:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789578985.828879:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789578985.829442:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f685180 x1876509277148800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789578985.829459:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277148800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578985.830875:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277149184:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.830936:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.830975:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277149696:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.831001:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.831017:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277150208:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.831039:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.831057:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789578985.831063:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277149312:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.831083:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.831096:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277149824:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.831115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.831128:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277150336:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.831163:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578985.831344:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149696 00000100:00100000:3.0:1789578985.831378:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149696 00000100:00100000:3.0:1789578985.831416:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789578985.831424:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277149696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578985.831606:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277149696:12345-0@lo:400:kworker.0 Request processed in 182us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578985.831614:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789578985.831734:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277149696:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.831863:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277150208 00000100:00100000:0.0:1789578985.831868:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277150208 00000100:00100000:0.0:1789578985.831904:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149312 00000100:00100000:0.0:1789578985.831906:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149312 00000100:00100000:0.0:1789578985.831916:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149824 00000100:00100000:0.0:1789578985.831918:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149824 00000100:00100000:0.0:1789578985.831929:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277150336 00000100:00100000:0.0:1789578985.831931:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277150336 00000100:00100000:0.0:1789578985.831943:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789578985.831949:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277150208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.831990:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277150208:12345-0@lo:400:kworker.0 Request processed in 42us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.831997:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789578985.832018:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789578985.832023:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277149312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832050:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277149312:12345-0@lo:400:kworker.0 Request processed in 27us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.832056:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789578985.832067:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789578985.832073:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832110:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277149824:12345-0@lo:400:kworker.0 Request processed in 38us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.832116:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789578985.832127:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789578985.832133:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277150336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832158:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277150336:12345-0@lo:400:kworker.0 Request processed in 25us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578985.832163:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1789578985.832185:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789578985.832188:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789578985.832198:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277149440:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832224:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578985.832243:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277149952:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832262:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578985.832279:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789578985.832285:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277149056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578985.832307:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578985.832324:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277149568:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578985.832401:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277150080:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.832420:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578985.832625:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149952 00000100:00100000:2.0:1789578985.832630:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149952 00000100:00100000:2.0:1789578985.832669:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149568 00000100:00100000:2.0:1789578985.832672:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149568 00000100:00100000:2.0:1789578985.832685:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789578985.832691:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277149952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.832721:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277149952:12345-0@lo:400:kworker.0 Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578985.832726:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789578985.832739:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789578985.832744:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277149568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.832784:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277149568:12345-0@lo:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578985.832790:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789578985.832804:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789578985.832824:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277149312:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.832834:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277149824:0@lo:400:kworker.0 00010000:00080000:2.0:1789578985.832856:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ac1c00 x1876509277150336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578985.832868:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277150336:0@lo:400:kworker.0 00000100:00100000:2.0:1789578985.832878:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277150208:0@lo:400:kworker.0 00000100:00100000:1.0:1789578985.834786:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149184 00000100:00100000:1.0:1789578985.834799:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149184 00000100:00100000:1.0:1789578985.834864:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789578985.834873:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277149184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578985.834949:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277149184:12345-0@lo:400:kworker.0 Request processed in 78us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578985.834955:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789578985.835013:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149440 00000100:00100000:1.0:1789578985.835017:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149440 00010000:00080000:0.0:1789578985.835172:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402ac3480 x1876509277149952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578985.835187:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277149952:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.835211:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277149568:0@lo:400:kworker.0 00000100:00100000:0.0:1789578985.835234:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277149056 00000100:00100000:0.0:1789578985.835237:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277149056 00000100:00100000:3.0:1789578985.836819:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277150080 00000100:00100000:3.0:1789578985.836830:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277150080 00000100:00100000:3.0:1789578985.836896:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789578985.836906:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277150080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578985.836981:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277150080:12345-0@lo:400:kworker.0 Request processed in 77us (4559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578985.837000:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789578985.837052:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277150080:0@lo:400:kworker.0 00000100:00080000:2.0:1789578985.842180:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789578985.842256:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277149184:0@lo:400:kworker.0 00000100:00100000:1.0:1789578985.842442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789578985.842458:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277149440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578985.842566:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277149440:12345-0@lo:400:kworker.0 Request processed in 112us (10341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578985.842573:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789578985.843681:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277149440:0@lo:400:kworker.0 00000100:00100000:3.0:1789578985.846698:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789578985.846723:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277149056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789578985.846750:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578985.846856:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277149056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (14546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578985.846863:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789578985.847068:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277149056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578986.342959:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578986.343050:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332096 00000100:00100000:2.0:1789578986.343060:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332096 00000100:00100000:2.0:1789578986.343120:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:2.0:1789578986.343131:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:11062:x1876509261332096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578986.343148:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578986.343296:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebed5 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343390:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343403:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343415:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578986.343457:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789578986.343461:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578986.343496:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343518:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f20feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebed5 expref: 7 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343537:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebed5 expref: 6 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578986.343558:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939432168900) 00010000:00010000:2.0:1789578986.343562:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578986.343566:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:2.0:1789578986.343657:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+6:11062:x1876509261332096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 528us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578986.343664:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789578986.367605:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578986.370837:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332224 00000100:00100000:0.0:1789578986.370864:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332224 00000100:00100000:0.0:1789578986.370926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789578986.370934:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+6:11063:x1876509261332224:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789578986.370951:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578986.370969:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f20ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebedc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371029:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371041:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371051:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371063:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371082:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371088:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371139:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371145:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371151:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578986.371184:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789578986.371187:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578986.371204:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371213:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371219:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371225:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371230:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578986.371234:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371245:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371256:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939432168900) 00010000:00010000:0.0:1789578986.371258:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578986.371263:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371268:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371396:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371403:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371409:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371413:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578986.371415:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371420:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371427:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff939302356a00) 00010000:00010000:0.0:1789578986.371429:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578986.371432:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371447:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371475:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f20ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebedc expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371487:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebedc expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578986.371494:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939302356c00) 00010000:00010000:0.0:1789578986.371496:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789578986.371498:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436800, rc 0) 00000100:00100000:0.0:1789578986.371812:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+7:11063:x1876509261332224:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 877us (4215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578986.371819:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789578986.389022:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578986.389326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332352 00000100:00100000:2.0:1789578986.389336:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332352 00000100:00100000:2.0:1789578986.389472:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789578986.389483:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+7:11063:x1876509261332352:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789578986.389570:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28fc5077-c53d-437a-bade-84c159d25114+7:11063:x1876509261332352:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 Request processed in 89us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578986.389578:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789578986.403194:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578986.404622:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332608 00000100:00100000:1.0:1789578986.404640:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332608 00000100:00100000:1.0:1789578986.404735:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:1.0:1789578986.404748:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+7:11063:x1876509261332608:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789578986.404774:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578986.404820:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21015 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebee3 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.404958:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.404976:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.404990:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405159:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405182:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405196:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405323:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f2102a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405332:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f2102a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.405339:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f2102a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578986.406137:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789578986.406235:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406260:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406267:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406273:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578986.406278:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406285:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406297:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939302356c00) 00010000:00010000:1.0:1789578986.406300:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578986.406305:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406310:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2101c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406324:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406330:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406336:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406341:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578986.406391:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406399:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406407:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939410126e00) 00010000:00010000:1.0:1789578986.406410:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578986.406413:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406419:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21023 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406679:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21015 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebee3 expref: 10 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406694:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f2102a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebee3 expref: 9 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578986.406701:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789578986.406703:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578986.406705:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519800, rc 0) 00000100:00100000:1.0:1789578986.406760:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+9:11063:x1876509261332608:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2015us (3581us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789578986.406767:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:0.0:1789578986.428681:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578986.428860:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332736 00000100:00100000:2.0:1789578986.428874:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332736 00000100:00100000:2.0:1789578986.428941:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789578986.428951:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+9:11063:x1876509261332736:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789578986.429150:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+9:11063:x1876509261332736:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 199us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578986.429159:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789578986.437147:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578986.437976:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332864 00000100:00100000:2.0:1789578986.437993:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332864 00000100:00100000:2.0:1789578986.438084:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789578986.438096:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:11063:x1876509261332864:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789578986.444556:0:6490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6388us 00000100:00100000:1.0:1789578986.464947:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:11063:x1876509261332864:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 26840us (27801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578986.464965:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000040:00080000:2.0:1789578986.540064:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789578986.596987:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789578986.665108:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578986.853343:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789578986.853401:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277150464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789578986.853505:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578986.853610:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277150464 00000100:00100000:1.0:1789578986.853620:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277150464 00000100:00100000:1.0:1789578986.853679:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789578986.853691:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277150464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789578986.853737:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789578986.854043:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277150464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 354us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578986.854052:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789578986.854114:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277150464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578986.854340:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789578986.854381:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277150592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578986.854422:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578986.854507:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277150592 00000100:00100000:3.0:1789578986.854514:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277150592 00000100:00100000:3.0:1789578986.854562:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789578986.854570:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277150592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578986.854598:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578986.854643:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277150592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578986.854649:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789578986.854781:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277150592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789578987.683492:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578988.396186:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578988.396247:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261332992 00000100:00100000:2.0:1789578988.396265:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261332992 00000100:00100000:2.0:1789578988.396339:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789578988.396386:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+9:11105:x1876509261332992:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578988.396404:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578988.396423:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebeea expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789578988.396466:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789578988.396482:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396495:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396508:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396522:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396528:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396534:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396572:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396579:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396593:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396599:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578988.396604:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396612:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396624:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939432168900) 00010000:00010000:2.0:1789578988.396628:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578988.396634:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396641:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2103f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396653:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396660:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396666:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396670:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aec00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578988.396674:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396691:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396700:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939432168e00) 00010000:00010000:2.0:1789578988.396702:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578988.396705:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396711:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21046 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396744:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21038 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeea expref: 10 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396756:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939432168900) 00010000:00010000:2.0:1789578988.396758:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578988.396761:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeea expref: 10 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.396770:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789578988.396836:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+9:11105:x1876509261332992:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 479us (651us total) trans 0 rc 301/301 00000100:00100000:2.0:1789578988.396847:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789578988.413500:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.413542:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261333248 00000100:00100000:0.0:1789578988.413553:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261333248 00000100:00100000:0.0:1789578988.413608:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789578988.413620:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+9:11105:x1876509261333248:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:0.0:1789578988.413689:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578988.413717:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f20ff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebed5 expref: 9 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.413736:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939432168900) 00010000:00010000:0.0:1789578988.413747:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789578988.413814:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.413967:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.413981:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.413998:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414005:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414012:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414783:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414808:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414816:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789578988.414923:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000409f3a87 reply state 000000002bc6482f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414934:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414941:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578988.414944:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789578988.414947:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789578988.414952:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789578988.414959:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414965:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414972:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414979:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578988.414983:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.414991:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.415010:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939412b0f100) 00010000:00010000:0.0:1789578988.415013:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578988.415016:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.415023:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f2104d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789578988.415037:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000409f3a87 reply state 000000002bc6482f transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.415046:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.415052:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939412b0f900) 00010000:00010000:0.0:1789578988.415055:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789578988.415057:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789578988.415259:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+10:11105:x1876509261333248:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 1639us (1764us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789578988.415268:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789578988.487339:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.487522:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261333376 00000100:00100000:1.0:1789578988.487532:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261333376 00000100:00100000:1.0:1789578988.487626:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:1.0:1789578988.487636:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+10:11113:x1876509261333376:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:1.0:1789578988.487659:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578988.487682:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebef1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487740:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487753:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487765:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578988.487836:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789578988.487840:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578988.487877:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487901:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef1 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487920:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef1 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.487929:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:1.0:1789578988.487932:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789578988.487935:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519400, rc 0) 00000100:00100000:1.0:1789578988.487996:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+11:11113:x1876509261333376:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 361us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578988.488003:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:0.0:1789578988.539623:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578988.539884:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261333504 00000100:00100000:2.0:1789578988.539894:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261333504 00000100:00100000:2.0:1789578988.540017:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:2.0:1789578988.540028:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+11:11119:x1876509261333504:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789578988.540062:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578988.540082:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebef8 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540144:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540158:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540169:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540179:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540186:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540192:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540266:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540275:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540281:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578988.540318:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789578988.540328:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578988.540412:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540424:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540429:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540435:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540441:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578988.540445:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540451:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540461:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:2.0:1789578988.540464:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578988.540469:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540474:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540486:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540492:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540507:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540512:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578988.540514:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540520:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540527:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939412b0f900) 00010000:00010000:2.0:1789578988.540529:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578988.540532:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540538:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2107e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540564:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef8 expref: 13 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540578:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef8 expref: 12 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.540585:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578988.540587:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789578988.540589:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af200, rc 0) 00000100:00100000:2.0:1789578988.540640:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+12:11119:x1876509261333504:12345-192.168.203.37@tcp:101:bash.0 Request processed in 614us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578988.540656:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:2.0:1789578988.545918:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.546061:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261333760 00000100:00100000:0.0:1789578988.546071:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261333760 00000100:00100000:0.0:1789578988.546156:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789578988.546167:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+12:11119:x1876509261333760:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789578988.546186:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578988.546205:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f2108c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebeff expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546325:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546339:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546386:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546439:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546447:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.546454:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789578988.546871:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789578988.547024:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547035:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547044:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547071:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547086:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547093:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547098:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578988.547102:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547110:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547121:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578988.547124:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578988.547129:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547135:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21093 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789578988.547147:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb494d92 reply state 00000000c3e6f153 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547156:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547162:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:1.0:1789578988.547165:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789578988.547167:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789578988.547193:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f2108c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547212:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.547219:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:1.0:1789578988.547221:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578988.547224:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:1.0:1789578988.547334:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+15:11119:x1876509261333760:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1168us (1423us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789578988.547341:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789578988.558035:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.558669:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261333888 00000100:00100000:3.0:1789578988.558681:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261333888 00000100:00100000:3.0:1789578988.558917:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:3.0:1789578988.558926:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876509261333888:12345-192.168.203.37@tcp:8:bash.0 00010000:00080000:3.0:1789578988.558964:0:8404:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:3.0:1789578988.558995:0:8404:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f210af 00002000:00100000:3.0:1789578988.559007:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28fc5077-c53d-437a-bade-84c159d25114/ffff939418b24000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789578988.559038:0:8404:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789578988.559117:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789578988.559151:0:8404:0:(import.c:65:import_set_state_nolock()) ffff939418b25000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578988.559231:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261333888:12345-192.168.203.37@tcp:8:bash.0 Request processed in 303us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578988.559239:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789578988.563761:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.563855:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261334016 00000100:00100000:3.0:1789578988.563865:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261334016 00000100:00080000:2.0:1789578988.563971:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789578988.564011:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:3.0:1789578988.564023:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261334016:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789578988.564049:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578988.564072:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf06 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789578988.564110:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789578988.564137:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789578988.564142:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789578988.564152:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.564171:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.564185:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:3.0:1789578988.564251:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+7:0:x1876509261334016:12345-192.168.203.37@tcp:101:bash.0 Request processed in 230us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578988.564284:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789578988.567318:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.567595:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261334144 00000100:00100000:0.0:1789578988.567603:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261334144 00000100:00100000:0.0:1789578988.567680:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:0.0:1789578988.567688:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:11119:x1876509261334144:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789578988.567711:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578988.567730:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf0d expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.567765:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.567786:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578988.567790:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578988.567796:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.567838:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.567851:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578988.567865:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277150720:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578988.567962:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578988.574030:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277150720:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578988.574282:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.574304:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436400, rc 0) 00000100:00100000:0.0:1789578988.574892:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:11119:x1876509261334144:12345-192.168.203.37@tcp:101:bash.0 Request processed in 7202us (7579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578988.574902:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789578988.578803:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.578972:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261334272 00000100:00100000:3.0:1789578988.578983:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261334272 00010000:00010000:3.0:1789578988.579025:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578988.579070:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789578988.579080:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261334272:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578988.579096:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578988.579118:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.579131:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.579160:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f210b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf06 expref: 8 pid: 8403 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.579178:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789578988.579182:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789578988.579190:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.579201:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.579258:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578988.579272:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6477:1876509277150848:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789578988.580293:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394372989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578988.583129:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f685180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6477:1876509277150848:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789578988.583162:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578988.583223:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261334272:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4143us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578988.583234:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:1.0:1789578988.589601:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.589688:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261334528 00000100:00100000:3.0:1789578988.589698:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261334528 00000100:00100000:1.0:1789578988.589848:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789578988.589861:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+15:11119:x1876509261334528:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789578988.590931:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+16:11119:x1876509261334528:12345-192.168.203.37@tcp:35:bash.0 Request processed in 1068us (1405us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789578988.590942:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00010000:00010000:2.0:1789578988.707729:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789578988.723009:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.723177:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261334784 00000100:00100000:1.0:1789578988.723188:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261334784 00000100:00100000:1.0:1789578988.723254:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789578988.723264:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+16:11130:x1876509261334784:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789578988.723288:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578988.723309:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f210c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf14 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578988.723484:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789578988.723852:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f210c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf14 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.723868:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:1.0:1789578988.723872:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578988.723878:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f210c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf14 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.723893:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518e00, rc 0) 00000100:00100000:1.0:1789578988.724007:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+17:11130:x1876509261334784:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 744us (1006us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789578988.724015:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789578988.728553:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.728609:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335040 00000100:00100000:3.0:1789578988.728620:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335040 00000100:00100000:3.0:1789578988.728757:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789578988.728768:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+17:11130:x1876509261335040:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578988.729006:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+18:11130:x1876509261335040:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 239us (474us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789578988.729014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789578988.829749:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578988.829927:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335168 00000100:00100000:2.0:1789578988.829937:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335168 00000100:00100000:2.0:1789578988.829992:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:2.0:1789578988.830099:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+18:11136:x1876509261335168:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578988.830121:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578988.830140:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f210d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf1b expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830200:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830213:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830223:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578988.830261:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789578988.830265:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578988.830294:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830318:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f210d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf1b expref: 20 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830402:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf1b expref: 19 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.830412:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578988.830415:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578988.830418:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789578988.830475:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+19:11136:x1876509261335168:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 375us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578988.834209:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:2.0:1789578988.837690:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.837766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335424 00000100:00100000:1.0:1789578988.837776:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335424 00000100:00100000:1.0:1789578988.837835:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:1.0:1789578988.837845:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+19:11136:x1876509261335424:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789578988.837865:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578988.837885:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f210e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf22 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.837982:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f210e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.838097:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f210e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.838126:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f210e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578988.838138:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789578988.838235:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f210e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf22 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.838253:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f210e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf22 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.838262:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:1.0:1789578988.838265:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578988.838269:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6000, rc 0) 00000100:00100000:1.0:1789578988.838613:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+21:11136:x1876509261335424:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 768us (930us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789578988.838621:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:1.0:1789578988.853917:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.854032:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335680 00000100:00100000:0.0:1789578988.854056:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335680 00000100:00100000:0.0:1789578988.854172:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:0.0:1789578988.854183:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:11136:x1876509261335680:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578988.854207:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578988.854228:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f210f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf29 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.854342:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.854518:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.854532:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578988.854546:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789578988.854649:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f210f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf29 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.854667:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf29 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.854675:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:0.0:1789578988.854678:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789578988.854681:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789578988.854745:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+23:11136:x1876509261335680:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 563us (837us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789578988.854752:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:1.0:1789578988.855963:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.856098:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335808 00000100:00100000:3.0:1789578988.856106:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335808 00000100:00100000:3.0:1789578988.856149:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789578988.856158:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+23:2393:x1876509261335808:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578988.856170:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578988.856198:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f210e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf22 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.856214:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:3.0:1789578988.856219:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578988.856272:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+22:2393:x1876509261335808:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578988.856581:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789578988.869786:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.869905:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261335936 00000100:00100000:0.0:1789578988.869915:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261335936 00000100:00100000:0.0:1789578988.869970:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:0.0:1789578988.869981:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261335936:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:0.0:1789578988.870037:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.870057:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.870066:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789578988.870071:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789578988.870075:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.870131:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.870281:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 7 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578988.870298:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10029:1876509277150976:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578988.870501:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460780 going to sleep for 11 seconds 00000100:00100000:0.0:1789578988.874956:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10029:1876509277150976:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578988.874986:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578988.880050:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.880342:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336064 00000100:00100000:0.0:1789578988.880393:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336064 00002000:00100000:0.0:1789578988.880442:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff939304172300 x1876509261336064/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:234/0 lens 504/0 e 0 to 0 dl 1789578999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789578988.880454:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304172300 with x1876509261336064 ext(0->12) 00010000:00010000:0.0:1789578988.880463:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 8 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.880480:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 8 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789578988.880489:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939304172300 00000100:00100000:0.0:1789578988.880511:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:0.0:1789578988.880518:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261336064:12345-192.168.203.37@tcp:4:lfs.0 00000001:00100000:3.0:1789578988.884081:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000100:00100000:0.0:1789578988.885071:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261336064:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 4545us (5022us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789578988.885084:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00002000:00100000:0.0:1789578988.885096:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff939304172300 x1876509261336064/t4294967300(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:234/0 lens 504/448 e 0 to 0 dl 1789578999 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789578988.885106:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304172300 with x1876509261336064 ext(0->12) 00010000:00010000:0.0:1789578988.885116:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.885215:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789578988.885224:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939304172300 00000100:00100000:2.0:1789578988.887817:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.888230:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336192 00000100:00100000:1.0:1789578988.888239:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336192 00010000:00010000:1.0:1789578988.888270:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578988.888315:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:1.0:1789578988.888325:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261336192:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578988.888339:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789578988.888403:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789578988.888406:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789578987 00002000:00010000:1.0:1789578988.888408:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789578988 00002000:00010000:1.0:1789578988.888410:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789578987 00002000:00010000:1.0:1789578988.888412:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789578988.888419:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.888432:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.888457:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000344c5080/0xd90373d592f210bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf0d expref: 9 pid: 8405 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.888474:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578988.888478:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578988.888484:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.888495:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.888597:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789578988.888615:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888624:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888643:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578988.888650:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261336192:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 326us (840us total) trans 0 rc 0/0 00010000:00010000:0.0:1789578988.888651:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578988.888657:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00010000:00010000:0.0:1789578988.888659:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888666:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578988.888669:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888678:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888704:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.888711:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f2110a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578988.888755:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261335936:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 18777us (18979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578988.888763:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:1.0:1789578988.891310:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.891390:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336448 00000100:00100000:0.0:1789578988.891401:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336448 00000100:00100000:0.0:1789578988.891455:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789578988.891466:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+22:11136:x1876509261336448:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:0.0:1789578988.891674:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf29 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789578988.892184:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789578988.892235:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789578988.893225:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789578988.893285:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.893304:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.893314:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.893422:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578988.893438:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 26 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578988.893452:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876509277151104:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578988.894085:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942001dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789578988.897734:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578988.898523:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876509277151104:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578988.898551:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578988.899085:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336576 00000100:00100000:3.0:1789578988.899094:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336576 00010000:00010000:3.0:1789578988.899133:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578988.899210:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:3.0:1789578988.899221:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+27:2395:x1876509261336576:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578988.899237:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578988.899245:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899259:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899299:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f210a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebeff expref: 27 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899336:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:3.0:1789578988.899341:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899368:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899376:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578988.899408:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578988.899460:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+26:2395:x1876509261336576:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 241us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578988.899468:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00010000:00010000:2.0:1789578988.899667:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.899676:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578988.899788:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789578988.899931:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789578988.900173:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277151232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789578988.900224:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578988.900264:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765600 going to sleep for 11 seconds 00000100:00100000:0.0:1789578988.900495:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277151232 00000100:00100000:0.0:1789578988.900502:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277151232 00000100:00100000:0.0:1789578988.900548:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789578988.900555:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1876509277151232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789578988.900631:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1876509277151232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578988.900637:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789578988.900658:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578988.901039:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277151232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789578988.901186:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789578988.901238:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277151360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789578988.901317:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578988.901345:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578988.901600:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277151360 00000100:00100000:0.0:1789578988.901606:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277151360 00000100:00100000:0.0:1789578988.901645:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789578988.901653:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1876509277151360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789578988.901759:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6493:x1876509277151360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (442us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789578988.901776:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789578988.902103:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277151360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789578988.902150:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789578988.902186:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902196:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902204:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902210:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578988.902215:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902223:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902238:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:2.0:1789578988.902241:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789578988.902246:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578988.902253:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21111 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789578988.902393:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789578988.902451:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789578988.902462:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344035110612ns, next at 345035108506ns, rc = 0 00000001:00080000:2.0:1789578988.902475:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789578988.902498:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126f00) 00010000:00010000:2.0:1789578988.902501:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789578988.902508:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f210fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf29 expref: 30 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578988.902591:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+29:11136:x1876509261336448:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 11126us (11286us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789578988.902599:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000020:00080000:2.0:1789578988.902603:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789578988.906631:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.906704:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336704 00000100:00100000:1.0:1789578988.906712:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336704 00000100:00100000:1.0:1789578988.906755:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789578988.906762:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+29:11136:x1876509261336704:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789578988.906780:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578988.906796:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21118 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf30 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.907062:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21118 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf30 expref: 30 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.907082:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21118 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf30 expref: 30 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.907103:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578988.907106:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789578988.907110:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:1.0:1789578988.907205:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+30:11136:x1876509261336704:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 441us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578988.907212:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:0.0:1789578988.911919:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578988.912145:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261336960 00000100:00100000:3.0:1789578988.912157:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261336960 00000100:00100000:3.0:1789578988.912216:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:3.0:1789578988.912227:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b602c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+30:11136:x1876509261336960:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578988.912742:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b602c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+31:11136:x1876509261336960:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 515us (829us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789578988.912751:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789578988.983543:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578988.986394:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261337216 00000100:00100000:1.0:1789578988.986410:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261337216 00000100:00100000:1.0:1789578988.986489:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789578988.986499:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+31:11146:x1876509261337216:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789578988.986524:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578988.986544:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2111f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf37 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578988.986660:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789578988.986760:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2111f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf37 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.986774:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:1.0:1789578988.986777:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578988.986782:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2111f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf37 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578988.986795:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:1.0:1789578988.986878:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+32:11146:x1876509261337216:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 380us (3347us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1789578988.986885:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789578989.001462:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578989.001550:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261337344 00000100:00100000:0.0:1789578989.001564:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261337344 00000100:00100000:0.0:1789578989.001633:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:0.0:1789578989.001642:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+32:11146:x1876509261337344:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789578989.001715:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001734:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001746:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001757:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001763:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001769:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001863:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001872:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001879:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789578989.001941:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001953:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001960:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001966:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001971:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578989.001976:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001982:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.001993:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578989.001995:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578989.001999:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002005:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2112d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002017:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002022:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002034:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002039:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578989.002042:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002048:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002055:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:0.0:1789578989.002057:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578989.002060:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002065:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002074:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002079:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002085:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002090:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578989.002093:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002111:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002131:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:0.0:1789578989.002133:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578989.002137:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578989.002150:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2113b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578989.002240:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+32:11146:x1876509261337344:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 597us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578989.002247:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:0.0:1789578989.010202:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578989.010289:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261337600 00000100:00100000:3.0:1789578989.010308:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261337600 00000100:00100000:2.0:1789578989.010773:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789578989.010791:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+32:11146:x1876509261337600:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789578989.011124:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+33:11146:x1876509261337600:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 337us (928us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789578989.011133:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:1.0:1789578989.060725:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.060953:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261337856 00000100:00100000:2.0:1789578989.060967:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261337856 00000100:00100000:2.0:1789578989.061048:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:2.0:1789578989.061060:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+33:11149:x1876509261337856:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578989.061095:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578989.061121:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21142 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf3e expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061214:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061254:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061268:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061283:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061296:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061302:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061474:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061483:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061490:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578989.061501:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789578989.061601:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061609:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061616:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061630:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578989.061636:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061645:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061660:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578989.061664:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578989.061671:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061688:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21149 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061706:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061712:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061718:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061723:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578989.061726:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061793:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061812:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:2.0:1789578989.061814:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578989.061826:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061834:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21150 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061884:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21142 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 36 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061899:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 35 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.061907:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.061909:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789578989.061912:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789578989.062004:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+35:11149:x1876509261337856:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 945us (1293us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789578989.062012:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789578989.074251:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.076544:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261337984 00000100:00100000:2.0:1789578989.076566:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261337984 00000100:00100000:2.0:1789578989.076665:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:2.0:1789578989.076678:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+35:11149:x1876509261337984:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:2.0:1789578989.076777:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.076799:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077081:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077131:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077139:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077147:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077153:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578989.077158:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077165:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077180:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.077183:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789578989.077189:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.077196:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578989.077310:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+35:11149:x1876509261337984:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 634us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578989.077318:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:0.0:1789578989.085548:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.085680:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261338240 00000100:00100000:2.0:1789578989.085712:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261338240 00000100:00100000:2.0:1789578989.085796:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789578989.085810:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+35:11149:x1876509261338240:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789578989.086132:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+36:11149:x1876509261338240:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 324us (596us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789578989.086141:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789578989.288122:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578989.288404:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261338496 00000100:00100000:3.0:1789578989.288418:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261338496 00000100:00100000:3.0:1789578989.288500:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:3.0:1789578989.288513:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+36:11180:x1876509261338496:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789578989.288565:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578989.288592:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2116c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf45 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.288724:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21173 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.288741:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.288755:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21173 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578989.288767:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789578989.288930:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2116c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf45 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.288950:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21173 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf45 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.288959:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578989.288962:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789578989.288967:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:3.0:1789578989.289042:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+38:11180:x1876509261338496:12345-192.168.203.37@tcp:101:cat.0 Request processed in 532us (935us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789578989.289049:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789578989.293652:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.293801:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261338752 00000100:00100000:2.0:1789578989.293813:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261338752 00000100:00100000:2.0:1789578989.293896:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789578989.293908:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+38:11180:x1876509261338752:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:2.0:1789578989.294601:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+39:11180:x1876509261338752:12345-192.168.203.37@tcp:35:cat.0 Request processed in 691us (959us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789578989.294612:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789578989.297515:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578989.297800:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261338880 00000100:00100000:3.0:1789578989.297814:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261338880 00000100:00100000:3.0:1789578989.297913:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789578989.297942:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+39:2393:x1876509261338880:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578989.297966:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578989.297999:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21173 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf45 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.298707:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578989.298717:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578989.298791:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+38:2393:x1876509261338880:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 850us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578989.298799:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:0.0:1789578989.367795:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578989.367912:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261339136 00000100:00100000:1.0:1789578989.367927:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261339136 00000100:00100000:1.0:1789578989.368043:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:1.0:1789578989.368055:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+38:11186:x1876509261339136:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:1.0:1789578989.368089:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578989.368093:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789578989.368126:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f210d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf1b expref: 38 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368161:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578989.368186:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578989.368205:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21181 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf4c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368646:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368664:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 38 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368673:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368733:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 38 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.368750:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 38 pid: 13782 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578989.368768:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151488:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789578989.368910:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408321180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578989.372179:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151488:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789578989.372223:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578989.372656:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578989.372706:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261339264 00000100:00100000:1.0:1789578989.372715:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261339264 00010000:00010000:1.0:1789578989.372765:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 39 pid: 13782 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578989.373057:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789578989.373069:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+39:2395:x1876509261339264:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578989.373088:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578989.373097:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 39 pid: 13782 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373120:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 39 pid: 13782 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373147:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf3e expref: 39 pid: 13782 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373346:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578989.373379:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373392:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373402:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.373492:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578989.373567:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+38:2395:x1876509261339264:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 499us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578989.373575:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00010000:00010000:2.0:1789578989.373616:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.373625:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578989.373650:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789578989.374319:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21181 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.374347:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.374394:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.374413:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789578989.374417:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6600, rc 0) 00000100:00100000:2.0:1789578989.374477:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+38:11186:x1876509261339136:12345-192.168.203.37@tcp:101:dd.0 Request processed in 6424us (6696us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789578989.374486:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789578989.380226:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.380456:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261339392 00000100:00100000:2.0:1789578989.380470:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261339392 00000100:00100000:2.0:1789578989.380614:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789578989.380626:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+38:11186:x1876509261339392:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789578989.380661:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578989.380687:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21196 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf53 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380731:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380749:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380764:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380933:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21196 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 40 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380954:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 39 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.380964:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.380974:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789578989.380979:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789578989.381097:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+39:11186:x1876509261339392:12345-192.168.203.37@tcp:101:dd.0 Request processed in 473us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578989.381106:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:0.0:1789578989.384835:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.384910:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261339648 00000100:00100000:2.0:1789578989.384923:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261339648 00000100:00100000:2.0:1789578989.384995:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789578989.385007:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+39:11186:x1876509261339648:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:2.0:1789578989.385302:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.385324:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.385339:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578989.385433:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1789578989.385461:0:13782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac5eaf0a reply state 00000000a8acb1dc transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.385477:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.385485:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.385488:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789578989.385492:0:13782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789578989.385616:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+42:11186:x1876509261339648:12345-192.168.203.37@tcp:36:dd.0 Request processed in 610us (810us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789578989.385624:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000020:00080000:2.0:1789578989.385647:0:13782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789578989.667848:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.668051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261339776 00000100:00100000:2.0:1789578989.668063:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261339776 00000100:00100000:2.0:1789578989.668124:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:2.0:1789578989.668135:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+42:11200:x1876509261339776:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789578989.668166:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578989.668195:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f211ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf5a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668540:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668558:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668572:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668585:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668592:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668598:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668685:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668696:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668728:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668768:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.668783:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 43 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578989.668798:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151616:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578989.669141:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765480 going to sleep for 11 seconds 00000100:00100000:1.0:1789578989.672671:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578989.673067:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261340032 00000100:00100000:3.0:1789578989.673080:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261340032 00000100:00100000:3.0:1789578989.673152:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789578989.673162:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+44:6163:x1876509261340032:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789578989.674032:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+45:6163:x1876509261340032:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 866us (1369us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789578989.674043:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:2.0:1789578989.675697:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151616:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578989.675740:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578989.676617:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578989.676703:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261340160 00000100:00100000:3.0:1789578989.676723:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261340160 00010000:00010000:3.0:1789578989.676773:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 45 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578989.676832:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789578989.676843:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+45:2394:x1876509261340160:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578989.676870:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578989.676878:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 45 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.676912:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 45 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.676940:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21188 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf4c expref: 45 pid: 6491 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.676962:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578989.676969:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.676980:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.676989:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578989.677290:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578989.677429:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+44:2394:x1876509261340160:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 586us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578989.677438:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00010000:00010000:1.0:1789578989.681810:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.681850:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578989.681942:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789578989.681948:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578989.682605:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682628:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682641:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682649:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682657:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682664:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578989.682670:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682678:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682696:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578989.682700:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578989.682706:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682723:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f211b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682746:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682752:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682758:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682764:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578989.682767:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682773:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682782:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:1.0:1789578989.682785:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578989.682788:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682794:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f211b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682948:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f211ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf5a expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682968:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf5a expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.682983:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578989.682986:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578989.682989:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:1.0:1789578989.683087:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+43:11200:x1876509261339776:12345-192.168.203.37@tcp:101:stat.0 Request processed in 14951us (15250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578989.683098:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00010000:00010000:0.0:1789578989.731559:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578989.749004:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578989.749122:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261340416 00000100:00100000:2.0:1789578989.749146:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261340416 00000100:00100000:2.0:1789578989.749231:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789578989.749244:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+43:11206:x1876509261340416:12345-192.168.203.37@tcp:36:truncate.0 00010000:00010000:2.0:1789578989.749320:0:9792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578989.749397:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f211c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf5a expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.749421:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.749427:0:9792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789578989.749666:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.749683:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.749694:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578989.749744:0:9792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789578989.749768:0:9792:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfd52165 reply state 000000001835052a transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.749782:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578989.749789:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578989.749792:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789578989.749795:0:9792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789578989.749960:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+45:11206:x1876509261340416:12345-192.168.203.37@tcp:36:truncate.0 Request processed in 719us (971us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789578989.749968:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000020:00080000:2.0:1789578989.749974:0:9792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789578989.898090:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578989.898213:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261340544 00000100:00100000:1.0:1789578989.898226:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261340544 00000100:00100000:1.0:1789578989.898301:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789578989.898315:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+45:11220:x1876509261340544:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:1.0:1789578989.898398:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578989.898428:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf61 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898516:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898534:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898551:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898562:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898569:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898598:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898703:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898713:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898720:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578989.898774:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789578989.898779:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578989.898804:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898834:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898844:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898850:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898857:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898864:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578989.898870:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898886:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898901:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578989.898904:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578989.898910:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898917:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f211d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898935:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898941:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898946:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898951:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578989.898954:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898960:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898967:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:1.0:1789578989.898970:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578989.898973:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.898988:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.899022:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.899038:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 46 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.899046:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578989.899048:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578989.899051:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:1.0:1789578989.899124:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+46:11220:x1876509261340544:12345-192.168.203.37@tcp:101:stat.0 Request processed in 813us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578989.899132:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:3.0:1789578989.989213:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578989.992915:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261340800 00000100:00100000:1.0:1789578989.992939:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261340800 00000100:00100000:1.0:1789578989.993044:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789578989.993058:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+46:11230:x1876509261340800:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789578989.993085:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578989.993112:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf68 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578989.993894:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789578989.994033:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf68 expref: 48 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.994072:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:1.0:1789578989.994076:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578989.994083:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf68 expref: 48 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578989.994103:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6600, rc 0) 00000100:00100000:1.0:1789578989.995173:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+47:11230:x1876509261340800:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2110us (5966us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1789578989.995186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:0.0:1789578990.003007:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.003909:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341056 00000100:00100000:3.0:1789578990.003925:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341056 00000100:00100000:3.0:1789578990.004021:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789578990.004036:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+47:11230:x1876509261341056:12345-192.168.203.37@tcp:35:lfs.0 00000100:00080000:0.0:1789578990.004808:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578990.005535:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+48:11230:x1876509261341056:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 1494us (2532us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789578990.005570:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:2.0:1789578990.081629:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.081792:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341312 00000100:00100000:1.0:1789578990.081806:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341312 00000100:00100000:1.0:1789578990.081891:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:1.0:1789578990.081904:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+48:11236:x1876509261341312:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789578990.081935:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578990.081964:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf6f expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.082101:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.082119:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.082129:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.082181:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 49 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.082214:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 49 pid: 6490 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578990.082231:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277151744:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789578990.082424:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408321cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578990.086938:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.087027:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341440 00000100:00100000:3.0:1789578990.087040:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341440 00010000:00010000:3.0:1789578990.087091:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 50 pid: 6490 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578990.087146:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:3.0:1789578990.087165:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+50:2395:x1876509261341440:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578990.087186:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578990.087194:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 50 pid: 6490 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.087208:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 50 pid: 6490 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.087236:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.087242:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.087254:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.087262:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.087286:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578990.087453:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f211e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf61 expref: 50 pid: 6490 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578990.087474:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277151744:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789578990.087502:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578990.087711:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+49:2395:x1876509261341440:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 546us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.087741:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00010000:00010000:1.0:1789578990.088090:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.088098:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578990.088122:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789578990.088295:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f211f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 50 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.088315:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 49 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.088324:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578990.088400:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789578990.088404:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789578990.088448:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+49:11236:x1876509261341312:12345-192.168.203.37@tcp:101:bash.0 Request processed in 6547us (6834us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789578990.088456:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:0.0:1789578990.092090:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.092197:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341696 00000100:00100000:3.0:1789578990.092210:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341696 00000100:00100000:3.0:1789578990.092279:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789578990.092292:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+49:11236:x1876509261341696:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:3.0:1789578990.092896:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.092919:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.092933:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789578990.092986:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789578990.093008:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3370a63 reply state 0000000039303636 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.093022:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.093030:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.093034:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578990.093038:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789578990.093282:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+52:11236:x1876509261341696:12345-192.168.203.37@tcp:36:bash.0 Request processed in 990us (1205us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789578990.093290:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000020:00080000:3.0:1789578990.093296:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789578990.099936:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.100041:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341824 00000100:00100000:1.0:1789578990.100055:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341824 00000100:00100000:1.0:1789578990.100137:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:1.0:1789578990.100149:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+52:11236:x1876509261341824:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789578990.100180:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578990.100207:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21214 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf76 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.100391:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.100410:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 53 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.100420:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.100461:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 53 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.100477:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 53 pid: 13782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578990.100493:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151872:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789578990.100618:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408321cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578990.103712:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.103888:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261341952 00000100:00100000:2.0:1789578990.103900:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261341952 00010000:00010000:2.0:1789578990.103949:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 54 pid: 13782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578990.103998:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:2.0:1789578990.104026:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+54:2395:x1876509261341952:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578990.104044:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578990.104052:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 54 pid: 13782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.104067:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 54 pid: 13782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.104094:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578990.104100:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.104112:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.104120:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.104142:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578990.104214:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+54:2395:x1876509261341952:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 190us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.104222:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00010000:00010000:1.0:1789578990.104900:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f211ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf6f expref: 53 pid: 13782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578990.104923:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277151872:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789578990.104951:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.104961:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.104968:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578990.105038:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789578990.105043:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578990.105068:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.105107:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21214 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf76 expref: 53 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.105125:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf76 expref: 52 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.105133:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578990.105137:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578990.105140:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:1.0:1789578990.105312:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+52:11236:x1876509261341824:12345-192.168.203.37@tcp:101:bash.0 Request processed in 5165us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.105332:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789578990.109162:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.109658:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342208 00000100:00100000:2.0:1789578990.109673:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342208 00000100:00100000:2.0:1789578990.109787:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789578990.109799:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b602850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+52:11236:x1876509261342208:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:2.0:1789578990.110121:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b602850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+53:11236:x1876509261342208:12345-192.168.203.37@tcp:35:bash.0 Request processed in 325us (984us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789578990.111077:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789578990.200712:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.200766:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.200808:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.200853:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.200896:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.200939:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342848 00000100:00100000:2.0:1789578990.200951:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342848 00000100:00100000:2.0:1789578990.201028:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342464 00000100:00100000:2.0:1789578990.201030:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342464 00000100:00100000:2.0:1789578990.201049:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342720 00000100:00100000:2.0:1789578990.201052:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342720 00000100:00100000:2.0:1789578990.201073:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 267 00000100:00100000:2.0:1789578990.201084:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261342848:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578990.201182:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261342848:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.201190:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 267 00000100:00100000:2.0:1789578990.201211:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 268 00000100:00100000:2.0:1789578990.201219:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261342464:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578990.201244:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261342464:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.201250:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 268 00000100:00100000:2.0:1789578990.201261:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 269 00000100:00100000:2.0:1789578990.201266:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261342720:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789578990.201287:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261342720:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.201308:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 269 00000100:00080000:2.0:1789578990.201327:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578990.201331:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789578990.201651:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342336 00000100:00100000:1.0:1789578990.201657:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342336 00000100:00100000:1.0:1789578990.201700:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 377 00000100:00100000:1.0:1789578990.201707:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261342336:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578990.201749:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261342336:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 43us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.201756:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 377 00000100:00100000:3.0:1789578990.201891:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261342592 00000100:00100000:3.0:1789578990.201903:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261342592 00000100:00100000:3.0:1789578990.201956:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:3.0:1789578990.201965:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942f361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261342592:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578990.201994:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942f361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261342592:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 32us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.202001:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00080000:0.0:1789578990.202259:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578990.208481:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578990.208584:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261343104 00000100:00100000:0.0:1789578990.208597:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261343104 00000100:00100000:0.0:1789578990.208667:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:0.0:1789578990.208678:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+53:11246:x1876509261343104:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578990.208707:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578990.208732:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f21222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf7d expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578990.208890:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789578990.209014:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f21222 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf7d expref: 55 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.209032:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:0.0:1789578990.209035:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789578990.209042:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f21222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf7d expref: 55 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.209059:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437800, rc 0) 00000100:00100000:0.0:1789578990.209139:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+54:11246:x1876509261343104:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 462us (672us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1789578990.209154:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:2.0:1789578990.212449:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578990.212548:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261343232 00000100:00100000:0.0:1789578990.212561:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261343232 00000100:00100000:0.0:1789578990.212632:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:0.0:1789578990.212644:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+54:11246:x1876509261343232:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789578990.212740:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.212762:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.212776:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.212789:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.212797:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.212804:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213094:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213105:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213113:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789578990.213187:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213219:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213227:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213235:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213242:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578990.213247:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213256:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213269:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578990.213273:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578990.213278:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213285:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213301:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213308:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213313:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213324:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578990.213328:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213335:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213342:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:0.0:1789578990.213345:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578990.213393:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213401:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21237 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213412:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213418:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213425:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213430:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578990.213434:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213440:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213459:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:0.0:1789578990.213462:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578990.213465:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.213472:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2123e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578990.213568:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+54:11246:x1876509261343232:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 923us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.213577:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:1.0:1789578990.216881:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.217017:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261343488 00000100:00100000:3.0:1789578990.217030:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261343488 00000100:00100000:3.0:1789578990.217101:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789578990.217112:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+54:11246:x1876509261343488:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578990.217458:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+55:11246:x1876509261343488:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 346us (592us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789578990.217466:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789578990.289491:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.289781:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261343744 00000100:00100000:3.0:1789578990.289796:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261343744 00000100:00100000:3.0:1789578990.289894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:3.0:1789578990.289907:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+55:11249:x1876509261343744:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578990.289938:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578990.289966:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21245 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf84 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290063:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290081:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290095:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290130:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290138:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290156:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290308:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2125a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290319:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2125a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290326:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2125a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578990.290771:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789578990.290975:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290985:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290992:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.290999:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.291004:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291027:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291041:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578990.291045:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.291051:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291058:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2124c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291077:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291084:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291090:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291096:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.291099:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291105:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291113:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:3.0:1789578990.291115:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.291118:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291134:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f21253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291664:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21245 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf84 expref: 58 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291684:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2125a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf84 expref: 57 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.291704:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.291706:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789578990.291709:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789578990.291800:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+57:11249:x1876509261343744:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1895us (2324us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789578990.291819:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:2.0:1789578990.297112:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.297179:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.297402:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261344000 00000100:00100000:1.0:1789578990.297415:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261344000 00000100:00100000:1.0:1789578990.297499:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789578990.297511:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+57:2395:x1876509261344000:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578990.297533:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578990.297566:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2125a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf84 expref: 57 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.297591:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578990.297597:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578990.297659:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+56:2395:x1876509261344000:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 150us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.297667:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789578990.300162:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261343872 00000100:00100000:3.0:1789578990.300184:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261343872 00000100:00100000:3.0:1789578990.300271:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:3.0:1789578990.300282:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+56:11249:x1876509261343872:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:3.0:1789578990.300413:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300434:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300448:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300517:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300526:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300532:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300539:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.300544:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300553:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300566:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.300570:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789578990.300575:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.300582:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578990.300677:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+56:11249:x1876509261343872:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 397us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.300686:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:2.0:1789578990.305260:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.305610:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261344256 00000100:00100000:3.0:1789578990.305625:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261344256 00000100:00100000:3.0:1789578990.305704:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:3.0:1789578990.305728:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+56:11249:x1876509261344256:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578990.307055:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+57:11249:x1876509261344256:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 1318us (1808us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789578990.307070:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789578990.504094:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578990.504278:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261344512 00000100:00100000:0.0:1789578990.504292:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261344512 00000100:00100000:0.0:1789578990.504412:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:0.0:1789578990.504424:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+57:11267:x1876509261344512:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:0.0:1789578990.504456:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578990.504482:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2126f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf8b expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.504614:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21276 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.504633:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21276 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.504646:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21276 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578990.504657:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789578990.504804:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2126f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf8b expref: 60 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.504838:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21276 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf8b expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.504848:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:0.0:1789578990.504851:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789578990.504856:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789578990.504940:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+59:11267:x1876509261344512:12345-192.168.203.37@tcp:101:cat.0 Request processed in 518us (863us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789578990.504948:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:2.0:1789578990.559224:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.559458:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261344640 00000100:00100000:3.0:1789578990.559472:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261344640 00000100:00100000:3.0:1789578990.559556:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:3.0:1789578990.559569:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+59:11268:x1876509261344640:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578990.559604:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578990.559631:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf92 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559717:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559736:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559751:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578990.559821:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789578990.559883:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789578990.559910:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559941:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf92 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559986:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf92 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.559996:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578990.559999:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789578990.560004:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37a00, rc 0) 00000100:00100000:3.0:1789578990.560143:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+60:11268:x1876509261344640:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 576us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.560151:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:3.0:1789578990.572506:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.572692:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345024 00000100:00100000:2.0:1789578990.572707:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345024 00000100:00100000:2.0:1789578990.572777:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789578990.572788:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+60:11268:x1876509261345024:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789578990.573193:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+61:11268:x1876509261345024:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 406us (701us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789578990.573202:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:1.0:1789578990.578819:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578990.578942:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345152 00000100:00100000:0.0:1789578990.578955:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345152 00000100:00100000:0.0:1789578990.579038:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789578990.579050:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+61:11268:x1876509261345152:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:0.0:1789578990.579071:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789578990.579104:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2121b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf76 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.579130:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21276 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf8b expref: 60 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.579143:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21118 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf30 expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.579155:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:0.0:1789578990.579178:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578990.580601:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+58:11268:x1876509261345152:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 203us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.580616:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789578990.582864:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.582962:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345280 00000100:00100000:1.0:1789578990.582975:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345280 00000100:00100000:1.0:1789578990.583048:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:1.0:1789578990.583077:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+58:11268:x1876509261345280:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:1.0:1789578990.583239:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.583274:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.583289:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789578990.583920:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789578990.584105:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789578990.584197:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789578990.584826:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+58:11268:x1876509261345280:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 1745us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.584839:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:3.0:1789578990.612498:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.612583:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345408 00000100:00100000:2.0:1789578990.612597:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345408 00000100:00100000:2.0:1789578990.612675:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:2.0:1789578990.612701:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+58:11270:x1876509261345408:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578990.612729:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578990.612757:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21299 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebf99 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612883:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612901:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612915:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612928:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612936:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.612944:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613033:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613044:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613051:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578990.613104:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789578990.613109:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578990.613132:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613156:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613166:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613173:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613180:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613186:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578990.613191:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613199:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613212:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578990.613215:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578990.613221:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613227:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613242:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613247:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613259:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613264:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578990.613280:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613287:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613295:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:2.0:1789578990.613298:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578990.613301:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613307:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613345:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21299 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 60 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613423:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 59 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.613430:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578990.613432:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578990.613435:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789578990.613517:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+59:11270:x1876509261345408:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 833us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.613534:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000040:00080000:0.0:1789578990.629246:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789578990.629276:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789578990.629323:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789578990.629341:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789578990.629550:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277152000:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789578990.629673:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942001dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789578990.640389:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277152000:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789578990.641016:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.641116:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345536 00000100:00100000:2.0:1789578990.641129:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345536 00000100:00100000:2.0:1789578990.641201:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:2.0:1789578990.641212:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+59:11272:x1876509261345536:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789578990.641253:0:6490:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789578990.641475:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+59:11272:x1876509261345536:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 263us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.641482:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:2.0:1789578990.658338:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.658515:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345664 00000100:00100000:1.0:1789578990.658527:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345664 00000100:00100000:1.0:1789578990.658603:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789578990.658616:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+59:11272:x1876509261345664:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789578990.658710:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.658733:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.658747:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.658933:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.658958:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659136:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659175:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659185:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659192:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578990.659248:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789578990.659252:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578990.659265:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659291:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659298:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.659304:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661196:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578990.661203:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661214:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661230:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789578990.661233:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578990.661238:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661246:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f212b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661265:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661672:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661683:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661689:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578990.661692:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661699:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661729:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff939410126800) 00010000:00010000:1.0:1789578990.661732:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578990.661735:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661741:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f212bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661762:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661768:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661774:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661779:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578990.661782:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661788:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661795:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578990.661798:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578990.661801:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.661817:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f212c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578990.661938:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+59:11272:x1876509261345664:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 3321us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.661947:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:1.0:1789578990.680958:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.681167:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261345920 00000100:00100000:2.0:1789578990.681177:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261345920 00000100:00100000:2.0:1789578990.681246:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:2.0:1789578990.681258:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+59:11272:x1876509261345920:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578990.681282:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578990.681305:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfa0 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681478:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681495:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681714:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578990.681728:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789578990.681827:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681835:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681842:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681849:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578990.681853:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681861:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681874:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578990.681878:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578990.681883:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681890:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f212d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681931:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfa0 expref: 61 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.681942:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:2.0:1789578990.681944:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789578990.681949:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f212ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfa0 expref: 61 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.682090:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789578990.682198:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261345920:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 942us (1249us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789578990.682206:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000040:00080000:2.0:1789578990.693901:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789578990.700927:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578990.701015:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261346048 00000100:00100000:0.0:1789578990.701025:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261346048 00000100:00100000:0.0:1789578990.701083:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:0.0:1789578990.701092:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261346048:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789578990.701125:0:13782:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789578990.701236:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261346048:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.701244:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:2.0:1789578990.719923:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.720270:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261346304 00000100:00100000:1.0:1789578990.720281:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261346304 00000100:00100000:3.0:1789578990.720576:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:3.0:1789578990.720589:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261346304:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789578990.720611:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578990.720614:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789578990.720638:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f2128b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf92 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.720657:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578990.720662:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578990.720674:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212df lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfa7 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789578990.721066:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789578990.721198:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f212e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.721217:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f212e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.721227:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f212e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.721278:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfa7 expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.721293:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f212e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfa7 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.721300:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9394039cee00) 00010000:00010000:3.0:1789578990.721303:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789578990.721305:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36600, rc 0) 00000100:00100000:3.0:1789578990.721656:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930350f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+61:11272:x1876509261346304:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1068us (1739us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789578990.721663:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00010000:00010000:2.0:1789578990.755576:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578990.762572:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.763150:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261346560 00000100:00100000:2.0:1789578990.763164:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261346560 00000100:00100000:2.0:1789578990.763235:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:2.0:1789578990.763247:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+61:11272:x1876509261346560:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789578990.763327:0:9792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578990.763408:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f212e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfa7 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.763436:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9394039cee00) 00010000:00010000:2.0:1789578990.763451:0:9792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578990.763818:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.763852:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.763865:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770074:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770115:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770130:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770525:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770534:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770541:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770547:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.770552:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770560:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770573:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578990.770576:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.770581:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770588:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f212f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770604:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770619:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770625:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770630:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.770633:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770639:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770647:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x61420ca9 (ffff9394039ce500) 00010000:00010000:3.0:1789578990.770650:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.770652:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.770658:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f212fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x61420ca9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578990.773256:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261346560:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 9999us (10687us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789578990.773269:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:2.0:1789578990.789938:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.790082:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261346688 00000100:00100000:3.0:1789578990.790095:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261346688 00000100:00100000:2.0:1789578990.790307:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789578990.790320:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+60:11272:x1876509261346688:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578990.790342:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578990.790397:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21302 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfae expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790644:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790658:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790670:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790786:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 62 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790820:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.790829:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:2.0:1789578990.790832:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789578990.790837:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789578990.790901:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+61:11272:x1876509261346688:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 584us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.790908:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:2.0:1789578990.794122:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.794663:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261346944 00000100:00100000:3.0:1789578990.794676:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261346944 00000100:00100000:3.0:1789578990.794754:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:3.0:1789578990.794766:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+61:11272:x1876509261346944:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789578990.794926:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.794949:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.794964:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789578990.795211:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789578990.795223:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345927872058ns, next at 346927869172ns, rc = 0 00000004:00010000:3.0:1789578990.795287:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef42c560 reply state 000000003fb433a8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.795302:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.795311:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578990.795314:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789578990.795319:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789578990.796272:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+63:11272:x1876509261346944:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1498us (2155us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789578990.796282:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:2.0:1789578990.808953:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.809092:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347072 00000100:00100000:3.0:1789578990.809106:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347072 00000100:00100000:3.0:1789578990.809180:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:3.0:1789578990.809192:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+63:11272:x1876509261347072:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789578990.809224:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578990.809252:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfb5 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.809396:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 64 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.809415:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 64 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.809439:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578990.809443:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789578990.809447:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37600, rc 0) 00000100:00100000:3.0:1789578990.809524:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+64:11272:x1876509261347072:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 334us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.809531:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:0.0:1789578990.813329:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.813565:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347200 00000100:00100000:3.0:1789578990.813580:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347200 00000100:00100000:3.0:1789578990.813637:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:3.0:1789578990.813647:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1876509261347200:12345-192.168.203.37@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789578990.813689:0:8403:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:3.0:1789578990.813755:0:8403:0:(genops.c:1384:class_connect()) connect: client 28fc5077-c53d-437a-bade-84c159d25114, cookie 0xd90373d592f2131e 00002000:00100000:3.0:1789578990.813770:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28fc5077-c53d-437a-bade-84c159d25114/ffff93943f581800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789578990.813792:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789578990.815509:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789578990.815581:0:8403:0:(import.c:65:import_set_state_nolock()) ffff939304137800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789578990.815685:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2391:x1876509261347200:12345-192.168.203.37@tcp:8:lhsmtool_posix.0 Request processed in 2037us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.815707:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:0.0:1789578990.825486:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.825628:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347328 00000100:00100000:3.0:1789578990.825642:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347328 00000100:00100000:3.0:1789578990.825732:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789578990.825744:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:0:x1876509261347328:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789578990.825941:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789578990.829953:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789578990.829976:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000100:00100000:3.0:1789578990.830216:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:0:x1876509261347328:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 4466us (4737us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789578990.830229:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789578990.845240:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.851001:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347584 00000100:00100000:2.0:1789578990.851024:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347584 00000100:00100000:3.0:1789578990.851206:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789578990.851219:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+64:11272:x1876509261347584:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789578990.851554:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+65:11272:x1876509261347584:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 336us (6326us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789578990.851562:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789578990.854225:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.854395:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347840 00000100:00100000:3.0:1789578990.854408:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347840 00000100:00100000:3.0:1789578990.854474:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:3.0:1789578990.854487:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+65:11272:x1876509261347840:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789578990.854623:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+65:11272:x1876509261347840:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 138us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.854631:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:3.0:1789578990.861944:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.862055:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261347968 00000100:00100000:1.0:1789578990.862069:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261347968 00000100:00100000:1.0:1789578990.862145:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:1.0:1789578990.862158:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+65:11272:x1876509261347968:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789578990.862184:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578990.862209:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21325 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfbc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862296:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862314:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862329:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578990.862431:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789578990.862455:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862508:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21325 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfbc expref: 67 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862531:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfbc expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.862541:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:1.0:1789578990.862544:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789578990.862549:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789578990.862632:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+66:11272:x1876509261347968:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 476us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.862640:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:2.0:1789578990.884565:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578990.884667:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348096 00000100:00100000:3.0:1789578990.884681:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348096 00000100:00100000:3.0:1789578990.884772:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:3.0:1789578990.884785:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261348096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789578990.884819:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578990.885033:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfc3 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789578990.885065:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaaceed, blocks: 0x0 00010000:00010000:3.0:1789578990.885089:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1789578990.885094:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789578990.885105:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.885128:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.885142:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36c00, rc 0) 00000100:00100000:3.0:1789578990.885214:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261348096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 432us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.885221:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789578990.888564:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.893608:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348352 00000100:00100000:2.0:1789578990.893630:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348352 00000100:00100000:2.0:1789578990.893770:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:2.0:1789578990.893783:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+66:11272:x1876509261348352:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789578990.893952:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+66:11272:x1876509261348352:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 171us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.893960:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:3.0:1789578990.901203:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.902613:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348480 00000100:00100000:2.0:1789578990.902631:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348480 00000100:00100000:2.0:1789578990.902745:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789578990.902759:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:11272:x1876509261348480:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578990.902783:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578990.902818:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfca expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.902859:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.902868:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578990.902873:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578990.902879:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.902920:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.902936:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578990.902966:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277152128:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578990.903086:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941aaee780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578990.911128:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277152128:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578990.911178:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.911205:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:3.0:1789578990.911280:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:11272:x1876509261348480:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 8524us (10091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.911296:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:1.0:1789578990.913454:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.913565:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348608 00000100:00100000:2.0:1789578990.913576:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348608 00010000:00010000:2.0:1789578990.913624:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578990.913696:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:2.0:1789578990.913706:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261348608:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578990.913724:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578990.913751:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.913765:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.913801:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f21333 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfc3 expref: 7 pid: 8403 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.913839:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578990.913843:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578990.913853:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.913876:0:13705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578990.913926:0:13705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578990.913944:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13705:1876509277152256:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789578990.914047:0:13705:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941aaee780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578990.918038:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13705:1876509277152256:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789578990.918086:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578990.918168:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261348608:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4462us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.918182:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:2.0:1789578990.918387:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578990.918496:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348736 00000100:00100000:2.0:1789578990.918504:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348736 00002000:00100000:2.0:1789578990.918558:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff939408eaed80 x1876509261348736/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:236/0 lens 504/0 e 0 to 0 dl 1789579001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789578990.918569:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939408eaed80 with x1876509261348736 ext(0->8) 00002000:00010000:2.0:1789578990.918575:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939408eaed80 00000100:00100000:2.0:1789578990.918610:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789578990.918621:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261348736:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789578990.920468:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261348736:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 1839us (2072us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789578990.920482:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00002000:00100000:2.0:1789578990.920495:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff939408eaed80 x1876509261348736/t4294967303(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:236/0 lens 504/448 e 0 to 0 dl 1789579001 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789578990.920632:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939408eaed80 with x1876509261348736 ext(0->8) 00002000:00010000:2.0:1789578990.920650:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939408eaed80 00000100:00100000:2.0:1789578990.932735:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.932839:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348864 00000100:00100000:1.0:1789578990.932853:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348864 00000100:00100000:1.0:1789578990.932934:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00100000:1.0:1789578990.932947:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+66:11272:x1876509261348864:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789578990.948511:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578990.948563:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277152384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578990.948656:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.948724:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277152384 00000100:00100000:0.0:1789578990.948734:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277152384 00000100:00100000:0.0:1789578990.948830:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789578990.948841:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277152384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789578990.948870:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578990.948923:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277152384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.948930:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789578990.948966:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789578990.949006:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277152384:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789578990.950609:0:10025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346083254852ns, next at 347083250779ns, rc = 0 00000100:00100000:1.0:1789578990.950772:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789578990.950792:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277152512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789578990.950873:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.950905:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277152896:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.950930:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.950965:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277153408:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.951005:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.951024:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277153920:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.951047:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.951064:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789578990.951069:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277153024:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.951088:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.951100:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277153536:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.951117:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951247:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277154048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578990.951272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951295:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277152640:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951322:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951375:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277153152:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951396:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951410:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277153664:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951428:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951442:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789578990.951447:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277152768:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951481:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951495:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277153280:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951511:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951527:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277153792:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951545:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578990.951566:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277152512 00000100:00100000:0.0:1789578990.951572:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277152512 00000100:00100000:0.0:1789578990.951618:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277154048 00000100:00100000:0.0:1789578990.951620:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277154048 00000100:00100000:0.0:1789578990.951634:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789578990.951643:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277152512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789578990.951673:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789578990.951708:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277152512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.951714:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789578990.951731:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578990.951736:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277154048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789578990.951744:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789578990.951766:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277154048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.951772:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789578990.951789:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277152640 00000100:00100000:0.0:1789578990.951792:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277152640 00000100:00100000:0.0:1789578990.951828:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789578990.951834:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277152640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951867:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277152640:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.951873:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789578990.951900:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277152896 00000100:00100000:0.0:1789578990.951903:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277152896 00000100:00100000:0.0:1789578990.951929:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153152 00000100:00100000:0.0:1789578990.951932:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153152 00000100:00100000:0.0:1789578990.951942:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789578990.951947:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277152896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.951976:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277152896:12345-0@lo:400:kworker.0 Request processed in 30us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.951982:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789578990.951991:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789578990.951995:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277153152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952014:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277153152:12345-0@lo:400:kworker.0 Request processed in 19us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952019:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789578990.952032:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789578990.952037:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578990.952068:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277154048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578990.952096:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277152640:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952105:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277153152:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952129:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277152896:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952142:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277152512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789578990.952160:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153408 00000100:00100000:0.0:1789578990.952163:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153408 00000100:00100000:0.0:1789578990.952186:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153024 00000100:00100000:0.0:1789578990.952188:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153024 00000100:00100000:0.0:1789578990.952196:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153664 00000100:00100000:0.0:1789578990.952198:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153664 00000100:00100000:0.0:1789578990.952209:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277152768 00000100:00100000:0.0:1789578990.952215:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277152768 00000100:00100000:0.0:1789578990.952228:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153280 00000100:00100000:0.0:1789578990.952230:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153280 00000100:00100000:0.0:1789578990.952240:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153792 00000100:00100000:0.0:1789578990.952242:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153792 00000100:00100000:0.0:1789578990.952253:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789578990.952258:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277153408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952288:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277153408:12345-0@lo:400:kworker.0 Request processed in 30us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952294:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789578990.952304:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789578990.952309:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277153024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952329:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277153024:12345-0@lo:400:kworker.0 Request processed in 20us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789578990.952342:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789578990.952346:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277153664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952399:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277153664:12345-0@lo:400:kworker.0 Request processed in 52us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952405:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789578990.952417:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789578990.952422:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277152768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952442:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277152768:12345-0@lo:400:kworker.0 Request processed in 20us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952447:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789578990.952455:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789578990.952460:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277153280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952486:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277153280:12345-0@lo:400:kworker.0 Request processed in 26us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952492:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789578990.952501:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789578990.952505:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277153792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952524:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277153792:12345-0@lo:400:kworker.0 Request processed in 19us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578990.952529:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:0.0:1789578990.952541:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789578990.952543:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789578990.952557:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277152768:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952566:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277153280:0@lo:400:kworker.0 00010000:00080000:0.0:1789578990.952577:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5e8a80 x1876509277153792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578990.952588:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277153792:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952597:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277153664:0@lo:400:kworker.0 00000100:00100000:0.0:1789578990.952621:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277153024:0@lo:400:kworker.0 00010000:00080000:0.0:1789578990.952632:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93943f5ea680 x1876509277153408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789578990.952641:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277153408:0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.955036:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153920 00000100:00100000:1.0:1789578990.955056:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153920 00000100:00100000:1.0:1789578990.955127:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277153536 00000100:00100000:1.0:1789578990.955131:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277153536 00000100:00100000:3.0:1789578990.955149:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789578990.955557:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277153920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789578990.955672:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277153920:12345-0@lo:400:kworker.0 Request processed in 514us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578990.955751:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277153920:0@lo:400:kworker.0 00000100:00080000:0.0:1789578990.956066:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789578990.962586:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789578990.962619:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277153536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789578990.962819:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277153536:12345-0@lo:400:kworker.0 Request processed in 217us (11699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.962828:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789578990.969286:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789578990.969394:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789578990.969419:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277154176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578990.971101:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.971270:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277154176 00000100:00100000:1.0:1789578990.971291:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277154176 00000100:00100000:1.0:1789578990.971378:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789578990.971390:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277154176:12345-0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1789578990.971398:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789578990.971411:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00002000:00000024:1.0:1789578990.971423:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000004:00080000:3.0:1789578990.971482:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789578990.971494:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277154176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.971500:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000020:00080000:3.0:1789578990.971789:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939405765240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789578990.971794:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939302aadf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9393034606c0 00000020:00080000:3.0:1789578990.971797:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939302aad600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939407832e00 00010000:00010000:3.0:1789578990.971871:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971884:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971917:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971924:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.971930:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971940:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971960:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939412b0f900) 00010000:00010000:3.0:1789578990.971963:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.971970:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.971976:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21054 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972002:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972008:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972013:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972018:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972020:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972033:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972041:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578990.972044:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.972046:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972051:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f2105b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972065:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972071:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972077:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972083:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972085:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972091:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972098:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f100) 00010000:00010000:3.0:1789578990.972101:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.972104:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972116:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2109a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972133:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972139:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972145:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972150:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972153:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972159:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972167:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.972170:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.972173:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972180:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f211a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972190:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972196:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972208:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972213:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972215:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972222:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972230:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.972233:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.972236:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972242:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f211c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972253:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972259:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972265:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972269:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972272:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972337:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972347:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:3.0:1789578990.972377:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578990.972380:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972385:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2120d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972398:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972404:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972409:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972414:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578990.972417:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972423:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972431:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578990.972434:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789578990.972437:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578990.972452:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21310 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578990.974953:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277154304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789578990.975052:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578990.975150:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277154176:0@lo:13:osp-pre-1-1.0 00000020:00080000:1.0:1789578990.975732:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1789578990.975827:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277153536:0@lo:400:kworker.0 00000020:00080000:1.0:1789578990.975971:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789578990.976072:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789578990.976084:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277154432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789578990.976135:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578990.976178:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277154304 00000100:00100000:1.0:1789578990.976186:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277154304 00000100:00100000:1.0:1789578990.976240:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277154432 00000100:00100000:1.0:1789578990.976243:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277154432 00000100:00100000:1.0:1789578990.976269:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789578990.976413:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277154304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789578990.977161:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789578990.977168:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789578990 00002000:00010000:1.0:1789578990.977171:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789578990.977173:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789578989 -> 1789578990 00002000:00010000:1.0:1789578990.977176:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789578990.977234:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277154304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 823us (2181us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789578990.977242:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789578990.977268:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789578990.977441:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939303bd4700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789578990.977449:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277154304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789578990.977585:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277154432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789578990.977610:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789578990.977645:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aaaceeb, atime: 0x6aaaceec, ctime: 0x6aaaceeb, blocks: 0x8 00010000:00010000:1.0:1789578990.977655:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.977674:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1789578990.977680:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789578990.977688:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.977726:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.977738:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.977747:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578990.977775:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789578990.977920:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+14:11272:x1876509261348864:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 44972us (45198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578990.977931:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 90 00010000:00010000:0.0:1789578990.978535:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578990.978545:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.978556:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578990.978561:0:10313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.978571:0:10313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.978593:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.978601:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f21341 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578990.978622:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578990.978624:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578990.978626:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578990.979818:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277154432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2523us (3663us total) trans 4294967302 rc 0/0 00000004:00080000:0.0:1789578990.979981:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93940f40d180/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789578990.979989:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93940f40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277154432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789578990.981921:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789578990.995004:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578990.995191:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261348992 00000100:00100000:1.0:1789578990.995204:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261348992 00000100:00100000:1.0:1789578990.995284:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:1.0:1789578990.995295:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2393:x1876509261348992:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789578990.998708:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789578990.998728:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789578990.999319:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261348992:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 4013us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578990.999335:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:1.0:1789578991.003298:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578991.003611:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261349248 00000100:00100000:3.0:1789578991.003628:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261349248 00000100:00100000:3.0:1789578991.003698:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:3.0:1789578991.003710:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+14:11272:x1876509261349248:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789578991.003764:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578991.003789:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f2132c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfbc expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.003820:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578991.003825:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578991.003854:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.003867:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.003890:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578991.004008:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e910273d reply state 00000000e91b3d5f transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.004020:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.004027:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578991.004029:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578991.004032:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789578991.005503:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+15:11272:x1876509261349248:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1787us (2210us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789578991.005927:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:3.0:1789578991.016255:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578991.017713:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261349376 00000100:00100000:1.0:1789578991.017735:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261349376 00000100:00100000:1.0:1789578991.017838:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:1.0:1789578991.017852:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261349376:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789578991.018080:0:8404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789578991.018085:0:8404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789578990 -> 1789578989 00002000:00010000:1.0:1789578991.018088:0:8404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789578988 00002000:00010000:1.0:1789578991.018091:0:8404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789578990 -> 1789578989 00002000:00010000:1.0:1789578991.018093:0:8404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789578991.018185:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261349376:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 335us (1940us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789578991.018193:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789578991.031172:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578991.031333:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261349632 00000100:00100000:0.0:1789578991.031398:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261349632 00000100:00100000:0.0:1789578991.031457:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:0.0:1789578991.031468:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+15:11272:x1876509261349632:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789578991.031573:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.031592:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.031601:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.031636:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.031652:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 15 pid: 6490 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.031667:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876509277154560:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578991.031767:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410354900 going to sleep for 11 seconds 00000100:00100000:3.0:1789578991.041589:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578991.041783:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261349760 00000100:00100000:2.0:1789578991.041801:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261349760 00010000:00010000:2.0:1789578991.041870:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 16 pid: 6490 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578991.041918:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:2.0:1789578991.041929:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+16:2394:x1876509261349760:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578991.041949:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578991.041957:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 16 pid: 6490 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.041972:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 16 pid: 6490 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.042001:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:2.0:1789578991.042007:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.042019:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.042028:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.042074:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578991.042150:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+16:2394:x1876509261349760:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 222us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578991.042159:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00010000:00010000:0.0:1789578991.042295:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21309 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfae expref: 15 pid: 6490 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.042318:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876509277154560:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578991.042407:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042420:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042427:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042490:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042499:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042520:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042527:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578991.042532:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042539:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042559:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:0.0:1789578991.042563:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789578991.042568:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.042574:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2134f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.042649:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+14:11272:x1876509261349632:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 11176us (11479us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789578991.042662:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:2.0:1789578991.046855:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578991.046974:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261349888 00000100:00100000:0.0:1789578991.046987:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261349888 00000100:00100000:0.0:1789578991.047060:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789578991.047092:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261349888:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789578991.047157:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.047180:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.047189:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578991.047193:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789578991.047199:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.047236:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.047251:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 7 pid: 8405 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.047267:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277154688:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578991.047582:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410354900 going to sleep for 11 seconds 00000100:00100000:0.0:1789578991.053305:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277154688:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578991.053388:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578991.061047:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578991.061245:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350016 00000100:00100000:1.0:1789578991.061263:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350016 00010000:00010000:1.0:1789578991.061325:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 8 pid: 8405 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578991.061454:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:1.0:1789578991.061466:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261350016:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578991.061487:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578991.064079:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 8 pid: 8405 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.064109:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 8 pid: 8405 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.064149:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f2133a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfca expref: 8 pid: 8405 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.064173:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578991.064200:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578991.064207:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.064218:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.064271:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578991.064665:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261350016:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 3198us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578991.064678:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00010000:00010000:0.0:1789578991.064855:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064876:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064906:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064916:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064925:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064932:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578991.064937:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064946:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064961:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.064970:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048832481/0xd90373d592f21356 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.065046:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261349888:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 17956us (18273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578991.065055:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:3.0:1789578991.079577:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578991.079769:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350272 00000100:00100000:1.0:1789578991.079779:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350272 00000100:00100000:1.0:1789578991.079846:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:1.0:1789578991.079857:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+14:11272:x1876509261350272:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789578991.079935:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.079952:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 14 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.079961:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.080196:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 14 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.080211:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 14 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578991.080245:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277154816:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789578991.080344:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303460480 going to sleep for 11 seconds 00000100:00100000:3.0:1789578991.094457:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277154816:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578991.094487:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578991.099931:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578991.100039:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350400 00000100:00100000:2.0:1789578991.100059:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350400 00010000:00010000:2.0:1789578991.100136:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578991.100200:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789578991.100214:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+15:2394:x1876509261350400:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578991.100248:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578991.100257:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100274:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100302:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2119d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf53 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100327:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578991.100335:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100415:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100426:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.100469:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578991.100547:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+14:2394:x1876509261350400:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 334us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578991.100556:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00010000:00010000:3.0:1789578991.100900:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.100914:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.101286:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.101303:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 14 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.101311:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.101395:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 14 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.101411:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 14 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578991.101425:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277154944:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789578991.101499:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298180 going to sleep for 11 seconds 00000100:00100000:3.0:1789578991.114478:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578991.114633:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277154944:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578991.114675:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.116984:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350528 00000100:00100000:0.0:1789578991.117007:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350528 00010000:00010000:0.0:1789578991.117071:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578991.117126:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:0.0:1789578991.117138:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+15:2393:x1876509261350528:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789578991.117158:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578991.117165:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117180:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117208:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfb5 expref: 15 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117227:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:0.0:1789578991.117233:0:9492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117244:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117289:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.117321:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578991.117426:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+14:2393:x1876509261350528:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 289us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578991.117435:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00010000:00010000:2.0:1789578991.117545:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.117555:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578991.117710:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789578991.117862:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789578991.117902:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789578991.118024:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277155072:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789578991.118101:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578991.118139:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943f5d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578991.118919:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277155072 00000100:00100000:0.0:1789578991.118928:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277155072 00000100:00100000:0.0:1789578991.118982:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789578991.118993:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13782:x1876509277155072:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789578991.119292:0:13782:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789578991.119300:0:13782:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939303bd4700, transno 4294967304 00000100:00100000:1.0:1789578991.119323:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f5e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277155072:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789578991.119527:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789578991.119607:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277155200:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789578991.119649:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578991.119683:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943f5d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789578991.119780:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277155200 00000100:00100000:3.0:1789578991.119795:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277155200 00000100:00100000:3.0:1789578991.119884:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789578991.119894:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13782:x1876509277155200:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789578991.120093:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13782:x1876509277155200:12345-0@lo:1000:mdt00_004.0 Request processed in 200us (442us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789578991.120101:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789578991.120678:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277155200:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789578991.120737:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120750:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120758:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120764:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578991.120769:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120778:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120797:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:1.0:1789578991.120832:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789578991.120840:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120847:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21364 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120891:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120898:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120905:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120910:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578991.120915:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120922:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120931:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:1.0:1789578991.120934:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789578991.120937:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120943:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21292 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120970:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.120995:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 17 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.121005:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.121041:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 17 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578991.121060:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 17 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578991.121075:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277155328:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578991.121308:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13782:x1876509277155072:12345-0@lo:1000:mdt00_004.0 Request processed in 127us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578991.121323:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789578991.121991:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943f5d2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789578991.133860:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277155328:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578991.133902:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578991.134511:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578991.134759:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350656 00000100:00100000:2.0:1789578991.134770:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350656 00010000:00010000:2.0:1789578991.134824:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 18 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578991.134860:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789578991.134871:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+18:2395:x1876509261350656:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578991.134890:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578991.134898:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 18 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.134912:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 18 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.134938:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f212ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebf99 expref: 18 pid: 9792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.134958:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578991.134963:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.134974:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.134983:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135014:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578991.135089:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+17:2395:x1876509261350656:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 219us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578991.135098:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00010000:00010000:2.0:1789578991.135138:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135146:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135161:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135168:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135181:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135191:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578991.135200:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135209:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135222:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578991.135224:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578991.135229:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135235:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2136b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135273:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135280:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135286:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135292:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578991.135295:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135301:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135308:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939410126100) 00010000:00010000:2.0:1789578991.135311:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789578991.135314:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578991.135320:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2135d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789578991.135768:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789578991.135775:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789578991.135795:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789578991.135812:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789578991.136012:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+16:11272:x1876509261350272:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 56155us (56442us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789578991.136036:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000020:00080000:2.0:1789578991.136043:0:13782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789578991.142593:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578991.142653:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261350912 00000100:00100000:3.0:1789578991.142673:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261350912 00000100:00100000:3.0:1789578991.142744:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789578991.142757:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+16:11272:x1876509261350912:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789578991.143110:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789578991.143155:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789578991.143196:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143217:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143232:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143241:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143248:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143255:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143276:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789578991.143410:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+18:11272:x1876509261350912:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 655us (831us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789578991.143419:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000020:00080000:3.0:1789578991.143426:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789578991.143455:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578991.143463:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143482:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789578991.143487:0:10312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143496:0:10312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143510:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:3.0:1789578991.143514:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789578991.143520:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143525:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21372 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.143538:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578991.143539:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578991.143541:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789578991.751324:0:14184:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789578991.751339:0:14184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789578991.751436:0:14184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789578991.751444:0:14184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789578991.779522:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789578991.923131:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578991.923269:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261351168 00000100:00100000:3.0:1789578991.923282:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261351168 00000100:00100000:3.0:1789578991.923538:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:3.0:1789578991.923551:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+18:11291:x1876509261351168:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578991.923587:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578991.923615:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfd1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.923791:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f21380 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.923823:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f21380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.923840:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f21380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578991.923854:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789578991.923995:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd1 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.924019:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f21380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd1 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.924029:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578991.924033:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789578991.924037:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37c00, rc 0) 00000100:00100000:3.0:1789578991.924123:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+20:11291:x1876509261351168:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 574us (1007us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789578991.924132:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789578991.927747:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578991.928264:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261351296 00000100:00100000:3.0:1789578991.928279:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261351296 00000100:00100000:3.0:1789578991.928400:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:3.0:1789578991.928413:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+20:11291:x1876509261351296:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:3.0:1789578991.928519:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928556:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928572:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928593:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928601:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928608:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928706:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928715:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928722:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578991.928780:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928795:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928822:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928840:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928847:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578991.928852:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928861:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928877:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578991.928880:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578991.928886:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928894:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2138e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928911:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928918:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928924:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928929:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578991.928932:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928949:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928959:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394039cea00) 00010000:00010000:3.0:1789578991.928962:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578991.928965:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928971:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928986:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928992:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.928998:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.929003:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578991.929006:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.929012:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.929019:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039ce100) 00010000:00010000:3.0:1789578991.929021:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578991.929025:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.929040:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2139c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578991.929142:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+20:11291:x1876509261351296:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 731us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578991.929151:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:0.0:1789578991.972141:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277155456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578991.972239:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789578991.972436:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277155456 00000100:00100000:3.0:1789578991.972447:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277155456 00000100:00100000:3.0:1789578991.972512:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789578991.972524:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277155456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789578991.972567:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789578991.972624:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277155456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578991.972631:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789578991.972742:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277155456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578991.973538:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789578991.973554:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277155584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578991.973603:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578991.973653:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277155584 00000100:00100000:0.0:1789578991.973659:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277155584 00000100:00100000:0.0:1789578991.973696:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789578991.973706:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277155584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578991.973736:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789578991.973789:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277155584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578991.973807:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789578991.973847:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277155584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789578991.992303:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578991.992444:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261351552 00000100:00100000:3.0:1789578991.992458:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261351552 00000100:00100000:3.0:1789578991.992528:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:3.0:1789578991.992540:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:11294:x1876509261351552:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578991.992568:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578991.992595:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f213a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfd8 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992683:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992701:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992730:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992748:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992755:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992763:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992915:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992924:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.992931:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578991.992943:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789578991.993036:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993045:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993052:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993058:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578991.993068:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993078:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993091:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578991.993094:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578991.993100:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993107:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993121:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993128:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993134:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993139:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578991.993143:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993149:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993158:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394039ce100) 00010000:00010000:3.0:1789578991.993160:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578991.993170:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993176:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993223:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f213a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 23 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993239:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578991.993247:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:3.0:1789578991.993250:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789578991.993253:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36e00, rc 0) 00000100:00100000:3.0:1789578991.993334:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+22:11294:x1876509261351552:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 795us (1044us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789578991.993343:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:2.0:1789578991.999422:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578991.999538:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261351680 00000100:00100000:0.0:1789578991.999551:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261351680 00000100:00100000:0.0:1789578991.999621:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:0.0:1789578991.999634:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+22:11294:x1876509261351680:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789578991.999729:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999751:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999766:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999823:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999831:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999839:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999846:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578991.999852:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999861:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999893:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:0.0:1789578991.999896:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789578991.999903:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578991.999911:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f213c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.000002:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+22:11294:x1876509261351680:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 370us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.000010:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:0.0:1789578992.007104:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.007208:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261351936 00000100:00100000:3.0:1789578992.007221:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261351936 00000100:00100000:3.0:1789578992.007315:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789578992.007330:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b600450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+22:11294:x1876509261351936:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578992.007630:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b600450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+23:11294:x1876509261351936:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 303us (539us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789578992.007637:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00080000:0.0:1789578992.008633:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578992.084025:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.084073:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352192 00000100:00100000:3.0:1789578992.084086:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352192 00000100:00100000:3.0:1789578992.084163:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:3.0:1789578992.084176:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+23:10822:x1876509261352192:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789578992.084208:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578992.084237:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f213cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfdf expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.084416:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.084437:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.084448:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.084489:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.084627:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 24 pid: 13782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578992.084644:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277155712:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789578992.084958:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394372986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578992.109273:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.109493:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352320 00000100:00100000:2.0:1789578992.109504:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352320 00010000:00010000:2.0:1789578992.109560:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 25 pid: 13782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.109605:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789578992.109615:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+25:2395:x1876509261352320:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578992.109632:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578992.109638:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 25 pid: 13782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.109652:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 25 pid: 13782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.109676:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.109682:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.109693:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.109702:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.109743:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578992.109822:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+25:2395:x1876509261352320:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 207us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.109830:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00010000:00010000:1.0:1789578992.114885:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f213b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd8 expref: 24 pid: 13782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578992.114916:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a80700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277155712:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789578992.114951:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.115752:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.115777:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578992.115819:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789578992.115993:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f213cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 25 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.116014:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 24 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.116025:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:1.0:1789578992.116029:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789578992.116033:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37600, rc 0) 00000100:00100000:1.0:1789578992.116213:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+24:10822:x1876509261352192:12345-192.168.203.37@tcp:101:bash.0 Request processed in 32038us (32196us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789578992.116224:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:2.0:1789578992.125994:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.126123:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352448 00000100:00100000:3.0:1789578992.126136:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352448 00000100:00100000:3.0:1789578992.126221:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:3.0:1789578992.126234:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+24:10822:x1876509261352448:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789578992.126268:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578992.126311:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfe6 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126749:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f213e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126768:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f213e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126784:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f213e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126951:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f213e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfe6 expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126970:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f213e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfe6 expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.126979:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.126982:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789578992.126986:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789578992.127069:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+25:10822:x1876509261352448:12345-192.168.203.37@tcp:101:bash.0 Request processed in 837us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.127078:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:1.0:1789578992.140014:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.140165:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352704 00000100:00100000:2.0:1789578992.140179:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352704 00000100:00100000:2.0:1789578992.140279:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789578992.140300:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+25:10822:x1876509261352704:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:2.0:1789578992.140631:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.140652:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.140665:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578992.140719:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789578992.140745:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005493e29d reply state 000000001e8419b5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.140759:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.140768:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.140771:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789578992.140777:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789578992.140834:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789578992.140954:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+29:10822:x1876509261352704:12345-192.168.203.37@tcp:36:bash.0 Request processed in 664us (953us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789578992.140962:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000020:00080000:2.0:1789578992.140967:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789578992.155711:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578992.155823:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352832 00000100:00100000:1.0:1789578992.155836:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352832 00000100:00100000:1.0:1789578992.155913:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:1.0:1789578992.155926:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+29:10822:x1876509261352832:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789578992.155959:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578992.155988:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f213f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebfed expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.156066:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f213f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfed expref: 30 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.156106:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f213f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfed expref: 30 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.156129:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:1.0:1789578992.156133:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789578992.156138:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789578992.156226:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+30:10822:x1876509261352832:12345-192.168.203.37@tcp:101:bash.0 Request processed in 302us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578992.156234:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:0.0:1789578992.158608:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.158667:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261352960 00000100:00100000:3.0:1789578992.158679:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261352960 00000100:00100000:3.0:1789578992.158772:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:3.0:1789578992.158786:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:10822:x1876509261352960:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789578992.158819:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578992.158846:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebff4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789578992.158847:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789578992.158879:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aaaceed, atime: 0x6aaaceec, ctime: 0x6aaaceed, blocks: 0x8 00010000:00010000:3.0:1789578992.158909:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1789578992.158914:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789578992.158923:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.158942:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.158954:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36600, rc 0) 00000100:00100000:3.0:1789578992.159031:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+7:10822:x1876509261352960:12345-192.168.203.37@tcp:101:bash.0 Request processed in 248us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578992.159039:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789578992.161138:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.161210:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353088 00000100:00100000:3.0:1789578992.161222:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353088 00002000:00010000:3.0:1789578992.161310:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789578992.161316:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939437389c00 with x1876509261353088 ext(0->18446744073709551615) 00002000:00010000:3.0:1789578992.161338:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939437389c00. 00000100:00100000:3.0:1789578992.161419:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:3.0:1789578992.161430:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261353088:12345-192.168.203.37@tcp:10:bash.0 00002000:00010000:3.0:1789578992.161789:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789578992.161794:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789578989 -> 1789578991 00002000:00010000:3.0:1789578992.161812:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789578988 -> 1789578988 00002000:00010000:3.0:1789578992.161814:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789578989 -> 1789578991 00002000:00010000:3.0:1789578992.161816:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789578992.161894:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261353088:12345-192.168.203.37@tcp:10:bash.0 Request processed in 465us (769us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789578992.161902:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00002000:00010000:3.0:1789578992.161906:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789578992.161909:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939437389c00 with x1876509261353088 ext(0->18446744073709551615) 00002000:00010000:3.0:1789578992.161915:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939437389c00. 00000100:00100000:0.0:1789578992.251760:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.251844:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353216 00000100:00100000:2.0:1789578992.251858:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353216 00000100:00100000:2.0:1789578992.251942:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789578992.251954:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+30:11308:x1876509261353216:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789578992.252072:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252095:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252108:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252125:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252132:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252138:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252577:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252590:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252599:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789578992.252658:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252671:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252690:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252697:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252704:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.252708:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252717:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252731:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578992.252734:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.252740:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252746:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252761:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252767:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252773:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252778:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.252784:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252791:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252809:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:2.0:1789578992.252811:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.252814:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252820:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2140c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252836:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252842:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252848:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252853:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.252855:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252860:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252866:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.252868:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.252876:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.252882:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.253023:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+30:11308:x1876509261353216:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1067us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.253032:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:2.0:1789578992.307679:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.307949:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353472 00000100:00100000:3.0:1789578992.307965:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353472 00000100:00100000:3.0:1789578992.308055:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:3.0:1789578992.308067:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+30:11311:x1876509261353472:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578992.308093:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578992.308118:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2141a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ebffb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308226:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308277:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308298:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308316:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308324:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308330:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308500:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f2142f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308511:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f2142f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308519:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f2142f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578992.308531:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789578992.308620:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308628:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308636:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308649:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578992.308654:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308663:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308676:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:3.0:1789578992.308679:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578992.308684:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308691:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21421 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308706:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308712:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308719:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308724:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789578992.308727:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308733:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308747:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394039cef00) 00010000:00010000:3.0:1789578992.308750:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789578992.308753:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308759:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21428 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308816:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2141a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebffb expref: 33 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308831:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f2142f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebffb expref: 32 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.308838:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:3.0:1789578992.308840:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789578992.308842:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36e00, rc 0) 00000100:00100000:3.0:1789578992.309137:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+32:11311:x1876509261353472:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1071us (1470us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789578992.309146:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:0.0:1789578992.319243:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578992.319408:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353600 00000100:00100000:1.0:1789578992.319430:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353600 00000100:00100000:1.0:1789578992.319505:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:1.0:1789578992.319516:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+32:11311:x1876509261353600:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789578992.319613:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.319636:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 32 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.319648:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.319691:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 32 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.319707:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 32 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578992.319748:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277155840:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789578992.319889:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789578992.327188:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277155840:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578992.327239:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.330036:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.330152:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353856 00000100:00100000:3.0:1789578992.330165:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353856 00000100:00100000:3.0:1789578992.330290:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789578992.330303:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+33:6630:x1876509261353856:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789578992.330904:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+34:6630:x1876509261353856:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 600us (880us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789578992.330913:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:1.0:1789578992.341924:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.342496:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261353984 00000100:00100000:3.0:1789578992.342510:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261353984 00010000:00010000:3.0:1789578992.342565:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 34 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578992.342624:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:3.0:1789578992.342636:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+34:2395:x1876509261353984:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578992.342660:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578992.342668:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 34 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342683:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 34 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342711:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f213d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfdf expref: 34 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342731:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:3.0:1789578992.342738:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342749:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342758:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578992.342837:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578992.342901:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+33:2395:x1876509261353984:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 267us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578992.342909:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00010000:00010000:1.0:1789578992.343044:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343054:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343106:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343113:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343120:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343126:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.343131:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343140:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343149:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:1.0:1789578992.343152:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578992.343156:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.343182:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2143d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578992.343226:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+32:11311:x1876509261353600:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 23712us (23998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578992.343235:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:2.0:1789578992.353909:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.354181:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261354240 00000100:00100000:3.0:1789578992.354194:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261354240 00000100:00100000:3.0:1789578992.354313:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789578992.354339:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+32:11311:x1876509261354240:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789578992.354677:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+33:11311:x1876509261354240:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 352us (780us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789578992.354686:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789578992.447048:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.447168:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261354496 00000100:00100000:2.0:1789578992.447182:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261354496 00000100:00100000:2.0:1789578992.447258:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:2.0:1789578992.447271:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+33:11322:x1876509261354496:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789578992.447302:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578992.447344:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21444 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec002 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447509:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447527:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447540:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447556:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447585:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447592:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447728:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21459 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447738:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447746:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578992.447757:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789578992.447873:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447881:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447888:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447895:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.447901:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447910:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447935:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578992.447938:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.447945:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447952:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2144b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447970:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447976:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447982:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447987:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.447989:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.447995:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.448002:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:2.0:1789578992.448004:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.448007:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.448012:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21452 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.448075:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21444 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec002 expref: 36 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.448092:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21459 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec002 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.448100:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.448102:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789578992.448105:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789578992.448195:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+35:11322:x1876509261354496:12345-192.168.203.37@tcp:101:cat.0 Request processed in 927us (1161us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789578992.448203:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:1.0:1789578992.454337:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.454526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261354752 00000100:00100000:0.0:1789578992.454539:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261354752 00000100:00100000:0.0:1789578992.454614:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:0.0:1789578992.454625:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+35:11322:x1876509261354752:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:0.0:1789578992.455021:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+36:11322:x1876509261354752:12345-192.168.203.37@tcp:35:cat.0 Request processed in 396us (713us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789578992.455030:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789578992.471118:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.471776:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355008 00000100:00100000:2.0:1789578992.471790:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355008 00000100:00100000:2.0:1789578992.472138:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:2.0:1789578992.472152:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+36:11323:x1876509261355008:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:2.0:1789578992.472229:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789578992.472264:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f213f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfed expref: 36 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472293:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21459 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec002 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472309:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f2142f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebffb expref: 34 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472595:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f213e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfe6 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472611:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.472618:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789578992.472647:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472662:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472673:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472689:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472695:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472702:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472809:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472818:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.472929:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789578992.473213:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789578992.473225:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347605873593ns, next at 348605870246ns, rc = 0 00010000:00010000:2.0:1789578992.473276:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473285:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473293:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473301:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473308:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473314:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473387:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789578992.473592:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578992.473601:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473623:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473629:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.473635:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.475059:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578992.475073:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.475101:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.475120:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:0.0:1789578992.475124:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789578992.475129:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.475136:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2147c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.475687:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578992.475692:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789578992.475695:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789578992.476123:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.476155:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476167:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476181:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:2.0:1789578992.476184:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789578992.476189:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476196:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21475 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476231:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476238:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476245:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476251:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.476254:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476260:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476268:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578992.476271:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.476281:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476288:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21467 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789578992.476302:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a8f9b3 reply state 000000005a7107aa transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476316:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.476803:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:2.0:1789578992.476806:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789578992.476811:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789578992.477178:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+34:11323:x1876509261355008:12345-192.168.203.37@tcp:36:rm.0 Request processed in 5021us (6066us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789578992.477189:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 106 00000100:00100000:0.0:1789578992.521642:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578992.521957:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355264 00000100:00100000:1.0:1789578992.521971:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355264 00000100:00100000:1.0:1789578992.522047:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:1.0:1789578992.522060:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+34:11329:x1876509261355264:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789578992.522091:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578992.522117:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21483 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec009 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522255:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522273:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522287:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522302:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522341:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.522573:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789578992.523197:0:9792:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789578992.523919:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.523935:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.523946:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.523992:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524000:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524008:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524015:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.524020:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524027:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524060:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578992.524063:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578992.524068:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524075:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2148a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789578992.524093:0:9792:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c52c227 reply state 0000000067530a4f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524106:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524112:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:1.0:1789578992.524114:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789578992.524118:0:9792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789578992.524170:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21483 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 37 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524187:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 36 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.524194:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789578992.524197:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578992.524199:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789578992.524396:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+37:11329:x1876509261355264:12345-192.168.203.37@tcp:101:bash.0 Request processed in 2338us (2770us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789578992.524407:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 107 00000100:00100000:3.0:1789578992.528867:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.528956:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355392 00000100:00100000:2.0:1789578992.528969:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355392 00000100:00100000:2.0:1789578992.529045:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:2.0:1789578992.529057:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261355392:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789578992.529080:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578992.529108:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec010 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789578992.529143:0:10029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789578992.529167:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1789578992.529173:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578992.529185:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 8 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.529228:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 8 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.529243:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00080000:0.0:1789578992.529372:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578992.529986:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261355392:12345-192.168.203.37@tcp:101:bash.0 Request processed in 928us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.529996:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:3.0:1789578992.532658:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.532762:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355520 00000100:00100000:2.0:1789578992.532776:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355520 00000100:00100000:2.0:1789578992.532856:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789578992.532867:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+8:11329:x1876509261355520:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789578992.532891:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578992.532916:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec017 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.532955:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.532972:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578992.532977:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578992.532983:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.533024:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.533057:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.533074:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277155968:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578992.533179:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789578992.535987:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.536141:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277155968:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578992.536186:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.536214:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789578992.536290:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+9:11329:x1876509261355520:12345-192.168.203.37@tcp:101:bash.0 Request processed in 3424us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.536300:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:0.0:1789578992.536552:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355648 00000100:00100000:0.0:1789578992.536560:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355648 00010000:00010000:0.0:1789578992.536600:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.536640:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:0.0:1789578992.536651:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261355648:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789578992.536669:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578992.536695:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.536727:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.536757:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051549117/0xd90373d592f214a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec010 expref: 9 pid: 10029 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.536775:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578992.536780:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578992.536789:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.536812:0:13705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.536854:0:13705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.536870:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13705:1876509277156096:192.168.203.37@tcp:105: 00000100:00100000:0.0:1789578992.536937:0:13705:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941a8f7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789578992.540503:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578992.540622:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13705:1876509277156096:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789578992.540657:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578992.540724:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261355648:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4074us (4750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578992.540738:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789578992.540850:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261355904 00000100:00100000:2.0:1789578992.540860:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261355904 00000100:00100000:2.0:1789578992.540914:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789578992.540924:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+37:11329:x1876509261355904:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:2.0:1789578992.541247:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+38:11329:x1876509261355904:12345-192.168.203.37@tcp:35:bash.0 Request processed in 324us (902us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789578992.541254:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:3.0:1789578992.691782:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.691924:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356032 00000100:00100000:0.0:1789578992.691937:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356032 00000100:00100000:0.0:1789578992.692013:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:0.0:1789578992.692026:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+38:11345:x1876509261356032:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578992.692083:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578992.692122:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f214b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec01e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.692219:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.692245:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.692259:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578992.692315:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789578992.692318:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578992.692341:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.693545:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f214b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec01e expref: 40 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.693575:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec01e expref: 39 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.693585:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578992.693588:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789578992.693592:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789578992.694202:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+39:11345:x1876509261356032:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2168us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.694213:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 108 00000100:00100000:0.0:1789578992.699443:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.699539:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356288 00000100:00100000:2.0:1789578992.699557:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356288 00000100:00100000:2.0:1789578992.699692:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:2.0:1789578992.699705:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+39:11345:x1876509261356288:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578992.699758:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578992.699803:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f214c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec025 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.699958:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f214c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.699976:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f214c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.699992:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f214c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578992.700006:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789578992.700148:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f214c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec025 expref: 42 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.700186:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f214c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec025 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.700197:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789578992.700201:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789578992.700204:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789578992.700804:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+41:11345:x1876509261356288:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1087us (1354us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789578992.700815:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:2.0:1789578992.706753:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.706857:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356544 00000100:00100000:0.0:1789578992.706874:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356544 00000100:00100000:0.0:1789578992.706965:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789578992.706978:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+41:2394:x1876509261356544:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789578992.706998:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578992.707028:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f214c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec025 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707054:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789578992.707061:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578992.707148:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+40:2394:x1876509261356544:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.707156:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789578992.707233:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.707397:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356672 00000100:00100000:0.0:1789578992.707404:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356672 00000100:00100000:0.0:1789578992.707522:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:0.0:1789578992.707533:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+40:11345:x1876509261356672:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578992.707559:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578992.707580:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f214d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec02c expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707741:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707759:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707785:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578992.707810:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789578992.707953:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f214d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec02c expref: 43 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707977:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec02c expref: 42 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.707986:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789578992.707989:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789578992.707992:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437a00, rc 0) 00000100:00100000:0.0:1789578992.708038:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+42:11345:x1876509261356672:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 508us (807us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789578992.708045:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:2.0:1789578992.714741:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.714885:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356800 00000100:00100000:0.0:1789578992.714897:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356800 00000100:00100000:0.0:1789578992.715003:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789578992.715016:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2393:x1876509261356800:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:0.0:1789578992.715075:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.715100:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.715110:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578992.715125:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789578992.715131:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.715177:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.715195:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 8 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.715212:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277156224:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578992.715917:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b607cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789578992.720198:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.720380:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261356928 00000100:00100000:2.0:1789578992.720393:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261356928 00002000:00100000:2.0:1789578992.720460:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff939303a33b80 x1876509261356928/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:238/0 lens 504/0 e 0 to 0 dl 1789579003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789578992.720472:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939303a33b80 with x1876509261356928 ext(0->8) 00010000:00010000:2.0:1789578992.720495:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 9 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.720516:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 9 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789578992.720524:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939303a33b80 00000100:00100000:0.0:1789578992.720765:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277156224:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578992.720808:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.720843:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:2.0:1789578992.720862:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261356928:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:2.0:1789578992.722072:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+11:2395:x1876509261356928:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 1213us (1884us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789578992.722088:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00002000:00100000:2.0:1789578992.722103:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff939303a33b80 x1876509261356928/t4294967303(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:238/0 lens 504/448 e 0 to 0 dl 1789579003 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789578992.722114:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939303a33b80 with x1876509261356928 ext(0->8) 00010000:00010000:2.0:1789578992.722125:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.722330:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789578992.722387:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939303a33b80 00000100:00100000:3.0:1789578992.725928:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.726673:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357056 00000100:00100000:2.0:1789578992.726688:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357056 00010000:00010000:2.0:1789578992.726745:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.726943:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:2.0:1789578992.726957:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+11:2394:x1876509261357056:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578992.726978:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789578992.727002:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789578992.727005:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789578991 00002000:00010000:2.0:1789578992.727007:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789578991 00002000:00010000:2.0:1789578992.727010:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789578991 00002000:00010000:2.0:1789578992.727012:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789578992.727020:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.727037:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.727066:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000dd74b7/0xd90373d592f214ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec017 expref: 11 pid: 8404 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.727088:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789578992.727093:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789578992.727131:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.727143:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.727186:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578992.727280:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+10:2394:x1876509261357056:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 327us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.727289:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00010000:00010000:0.0:1789578992.728387:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728404:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728435:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728444:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728478:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728486:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578992.728491:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728501:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728519:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.728528:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f214ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.728624:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+9:2393:x1876509261356800:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 13608us (14010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.728640:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:3.0:1789578992.734108:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.734723:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357312 00000100:00100000:2.0:1789578992.734738:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357312 00000100:00100000:2.0:1789578992.734818:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789578992.734829:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b601c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+42:11345:x1876509261357312:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:2.0:1789578992.734893:0:6493:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec02c expref: 42 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789578992.735087:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789578992.737035:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789578992.738864:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789578992.738992:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.739014:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 46 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.739023:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.739079:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 46 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.739111:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 46 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.739127:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876509277156352:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578992.740223:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789578992.742665:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402ac0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6493:1876509277156352:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578992.742707:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578992.743190:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.743597:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357440 00000100:00100000:0.0:1789578992.743610:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357440 00010000:00010000:0.0:1789578992.743661:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 47 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578992.743771:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789578992.743818:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+47:2394:x1876509261357440:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789578992.743845:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578992.743854:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 47 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743870:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 47 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743897:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21498 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec009 expref: 47 pid: 9792 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743919:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789578992.743925:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743936:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743946:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.743984:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578992.744055:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+46:2394:x1876509261357440:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 242us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.744062:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00010000:00010000:1.0:1789578992.744126:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.744135:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789578992.744296:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789578992.744451:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789578992.744564:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277156480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789578992.744627:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578992.744661:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1789578992.745153:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277156480 00000100:00100000:3.0:1789578992.745170:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277156480 00000100:00080000:0.0:1789578992.745310:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789578992.745463:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789578992.745475:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6493:x1876509277156480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789578992.745601:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6493:x1876509277156480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578992.745609:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789578992.745640:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277156480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789578992.745785:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789578992.745867:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277156608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789578992.745900:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789578992.745928:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578992.745970:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277156608 00000100:00100000:3.0:1789578992.745974:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277156608 00000100:00100000:3.0:1789578992.746008:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789578992.746013:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6493:x1876509277156608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789578992.746107:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6493:x1876509277156608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (208us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789578992.746112:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789578992.746165:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6493:1876509277156608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789578992.746197:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789578992.746226:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746236:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746243:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746250:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.746266:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746276:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746292:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789578992.746295:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789578992.746301:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.746308:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f214f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789578992.746571:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789578992.746643:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789578992.746655:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347879303825ns, next at 348879300900ns, rc = 0 00000001:00080000:1.0:1789578992.746663:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789578992.746691:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789578992.746694:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789578992.746701:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f214de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec02c expref: 50 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578992.746825:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b601c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+49:11345:x1876509261357312:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 11997us (12730us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789578992.746834:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000020:00080000:1.0:1789578992.746839:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789578992.749820:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.749977:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357568 00000100:00100000:0.0:1789578992.749990:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357568 00000100:00100000:0.0:1789578992.750068:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:0.0:1789578992.750097:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+49:11345:x1876509261357568:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578992.750129:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578992.750157:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f214fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec033 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.750229:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f214fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec033 expref: 50 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.750247:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f214fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec033 expref: 50 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.750270:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578992.750273:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789578992.750288:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789578992.750394:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+50:11345:x1876509261357568:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 300us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578992.750403:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 111 00000100:00100000:3.0:1789578992.752533:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.752644:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357824 00000100:00100000:2.0:1789578992.752656:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357824 00000100:00100000:2.0:1789578992.752716:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789578992.752728:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+50:11345:x1876509261357824:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789578992.753045:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+51:11345:x1876509261357824:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 319us (524us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789578992.753054:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00010000:00010000:2.0:1789578992.804589:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578992.845133:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578992.845283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261357952 00000100:00100000:2.0:1789578992.845297:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261357952 00000100:00100000:2.0:1789578992.845404:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:2.0:1789578992.845417:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+51:11355:x1876509261357952:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789578992.845519:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845557:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845572:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845585:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845593:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845600:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845695:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845704:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845711:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789578992.845772:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845787:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845806:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845824:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845831:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.845836:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845845:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845861:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578992.845865:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.845871:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845878:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21501 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845895:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845902:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845907:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845912:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aec00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.845914:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845929:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845937:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:2.0:1789578992.845939:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.845942:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845947:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f21508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845956:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845962:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845967:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845970:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578992.845973:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845977:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.845983:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578992.845985:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578992.845987:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578992.846000:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2150f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578992.846101:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+51:11355:x1876509261357952:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 686us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578992.846110:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 112 00000100:00100000:3.0:1789578992.893700:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.894752:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261358208 00000100:00100000:0.0:1789578992.894768:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261358208 00000100:00100000:0.0:1789578992.894871:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:0.0:1789578992.894885:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+51:11358:x1876509261358208:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578992.894915:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578992.894943:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21516 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec03a expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.895039:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.895130:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.895148:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.895163:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.896901:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578992.896927:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897683:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897699:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897727:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578992.897741:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789578992.897861:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897869:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897875:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897882:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.897887:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897895:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897910:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578992.897914:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578992.897921:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897928:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2151d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897945:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897951:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897964:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897969:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.897972:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897979:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897987:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:1.0:1789578992.897989:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578992.897992:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.897998:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.898056:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21516 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 54 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.898073:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 53 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.898081:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578992.898083:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789578992.898086:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6000, rc 0) 00000100:00100000:1.0:1789578992.898263:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+53:11358:x1876509261358208:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 3379us (4575us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789578992.898283:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 113 00000100:00100000:0.0:1789578992.909075:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578992.909497:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261358336 00000100:00100000:1.0:1789578992.909511:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261358336 00000100:00100000:1.0:1789578992.909576:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:1.0:1789578992.909589:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+53:11358:x1876509261358336:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789578992.909678:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909699:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909713:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909755:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909763:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909770:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909777:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578992.909782:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909799:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909813:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578992.909834:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578992.909841:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578992.909848:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578992.909991:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+53:11358:x1876509261358336:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 403us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578992.909999:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 114 00000100:00100000:3.0:1789578992.915228:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578992.915314:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261358592 00000100:00100000:0.0:1789578992.915341:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261358592 00000100:00100000:0.0:1789578992.915434:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789578992.915446:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+53:11358:x1876509261358592:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789578992.916279:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+54:11358:x1876509261358592:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 830us (1061us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789578992.916291:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:3.0:1789578993.005718:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.005845:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261358848 00000100:00100000:0.0:1789578993.005858:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261358848 00000100:00100000:0.0:1789578993.005964:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:0.0:1789578993.005975:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+54:11368:x1876509261358848:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789578993.006007:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.006026:0:13782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789578993.006067:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f214bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec01e expref: 54 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006088:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578993.006095:0:13782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789578993.006109:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f21540 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec041 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006253:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006271:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 54 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006279:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006775:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 54 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.006806:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 54 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.006824:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156736:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578993.006954:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b6076c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.012963:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156736:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578993.013007:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.013956:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.014312:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261358976 00000100:00100000:1.0:1789578993.014424:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261358976 00010000:00010000:1.0:1789578993.014476:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 55 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.014531:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:1.0:1789578993.014541:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+55:2395:x1876509261358976:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578993.014560:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578993.014568:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 55 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014581:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 55 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014605:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2152b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec03a expref: 55 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014625:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578993.014631:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014656:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014664:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.014759:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578993.014836:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+54:2395:x1876509261358976:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 295us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.014844:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00010000:00010000:0.0:1789578993.016778:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.016807:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578993.016992:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789578993.017481:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f21540 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 55 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.017508:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 54 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.017519:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.017522:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789578993.017527:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437e00, rc 0) 00000100:00100000:0.0:1789578993.017619:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+54:11368:x1876509261358848:12345-192.168.203.37@tcp:101:bash.0 Request processed in 11644us (11912us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789578993.017629:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:2.0:1789578993.023740:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.023852:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261359104 00000100:00100000:1.0:1789578993.023866:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261359104 00000100:00100000:1.0:1789578993.023934:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:1.0:1789578993.023945:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+54:11368:x1876509261359104:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789578993.023974:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578993.023999:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21555 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec048 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024041:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024057:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024070:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024218:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21555 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 56 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024251:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 55 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.024261:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578993.024265:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789578993.024270:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:1.0:1789578993.024605:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+55:11368:x1876509261359104:12345-192.168.203.37@tcp:101:bash.0 Request processed in 660us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.024620:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:3.0:1789578993.027022:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.027105:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261359360 00000100:00100000:0.0:1789578993.027117:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261359360 00000100:00100000:0.0:1789578993.027183:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:0.0:1789578993.027193:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+55:11368:x1876509261359360:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:0.0:1789578993.027503:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.027524:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.027554:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789578993.027601:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789578993.027637:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081c5bfa9 reply state 00000000aafc13f9 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.027651:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.027659:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.027662:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789578993.027667:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789578993.028749:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+58:11368:x1876509261359360:12345-192.168.203.37@tcp:36:bash.0 Request processed in 1546us (1729us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789578993.028760:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000020:00080000:0.0:1789578993.028768:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789578993.031337:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.031723:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261359488 00000100:00100000:0.0:1789578993.031736:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261359488 00000100:00100000:0.0:1789578993.031819:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:0.0:1789578993.031830:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+58:11368:x1876509261359488:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789578993.031861:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.031886:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2156a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec04f expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.032001:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.032018:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.032047:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.032087:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.032103:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 59 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.032120:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156864:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578993.032208:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b6076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789578993.035281:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.035414:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156864:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578993.035451:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.035650:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261359616 00000100:00100000:3.0:1789578993.035658:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261359616 00010000:00010000:3.0:1789578993.035703:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 60 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.035745:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:3.0:1789578993.035775:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+60:2394:x1876509261359616:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789578993.035803:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578993.035813:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 60 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035835:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 60 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035861:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21547 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec041 expref: 60 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035879:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:3.0:1789578993.035884:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035896:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035906:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.035935:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789578993.035997:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+59:2394:x1876509261359616:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 224us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578993.036005:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00010000:00010000:0.0:1789578993.036385:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.036395:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578993.036463:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789578993.036468:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578993.036491:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.036527:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2156a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.036561:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 58 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.036569:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.036573:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789578993.036576:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789578993.036625:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+58:11368:x1876509261359488:12345-192.168.203.37@tcp:101:bash.0 Request processed in 4796us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.036632:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:2.0:1789578993.040191:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.040285:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261359872 00000100:00100000:1.0:1789578993.040297:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261359872 00000100:00100000:1.0:1789578993.040411:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:1.0:1789578993.040422:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+58:11368:x1876509261359872:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789578993.040700:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+59:11368:x1876509261359872:12345-192.168.203.37@tcp:35:bash.0 Request processed in 279us (523us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789578993.040708:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:1.0:1789578993.088914:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.089006:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360000 00000100:00100000:2.0:1789578993.089021:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360000 00000100:00100000:2.0:1789578993.089091:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:2.0:1789578993.089104:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+59:11374:x1876509261360000:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789578993.089135:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578993.089161:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec056 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089248:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089264:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089277:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578993.089338:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789578993.089343:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578993.089488:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089516:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec056 expref: 61 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089536:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec056 expref: 60 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.089545:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:2.0:1789578993.089549:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789578993.089553:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789578993.089771:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261360000:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 669us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.089780:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:3.0:1789578993.091779:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.091965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360128 00000100:00100000:0.0:1789578993.091976:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360128 00000100:00100000:0.0:1789578993.092040:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:0.0:1789578993.092051:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261360128:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578993.092075:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.092099:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21586 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec05d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092170:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092185:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092198:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092210:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092233:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092240:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092526:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092537:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092545:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578993.092596:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789578993.092601:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578993.092684:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092699:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092708:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092716:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092724:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092740:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578993.092745:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092754:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092768:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578993.092772:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578993.092777:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092784:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f2158d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092812:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092819:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092940:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092947:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578993.092950:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092957:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092976:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:0.0:1789578993.092979:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578993.092982:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.092988:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.093021:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21586 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec05d expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.093034:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec05d expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.093041:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.093043:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789578993.093045:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436a00, rc 0) 00000100:00100000:0.0:1789578993.093115:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+61:11374:x1876509261360128:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1066us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.093123:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:1.0:1789578993.096701:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.096787:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360256 00000100:00100000:0.0:1789578993.096810:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360256 00000100:00100000:0.0:1789578993.096897:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789578993.096911:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+61:2395:x1876509261360256:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789578993.096936:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789578993.096967:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f2159b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec05d expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.097013:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.097019:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789578993.097092:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+60:2395:x1876509261360256:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 183us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.097101:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789578993.098208:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.098279:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360512 00000100:00100000:0.0:1789578993.098287:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360512 00000100:00100000:0.0:1789578993.098526:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:0.0:1789578993.098539:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261360512:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578993.098563:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.098584:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f215a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec064 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.098729:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.098748:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 61 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.098758:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.098808:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 61 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.098831:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 61 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.098867:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156992:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578993.098977:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943b6076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578993.102209:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.102425:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277156992:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578993.102465:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.104799:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360640 00000100:00100000:2.0:1789578993.104818:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360640 00010000:00010000:2.0:1789578993.104886:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 62 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.105047:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:2.0:1789578993.105059:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+62:2394:x1876509261360640:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578993.105082:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.105089:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 62 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105105:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 62 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105155:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec04f expref: 62 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105174:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.105180:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105191:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105200:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.105238:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.105310:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+61:2394:x1876509261360640:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 253us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.105331:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00010000:00010000:0.0:1789578993.105415:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.105425:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578993.105448:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789578993.105620:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f215a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 62 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.105636:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 61 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.105644:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.105647:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789578993.105650:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436c00, rc 0) 00000100:00100000:0.0:1789578993.105678:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+61:11374:x1876509261360512:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 7144us (7479us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789578993.105685:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:3.0:1789578993.108605:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.108731:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261360896 00000100:00100000:2.0:1789578993.108745:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261360896 00000100:00100000:2.0:1789578993.108836:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789578993.108850:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+61:11374:x1876509261360896:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:2.0:1789578993.108870:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.108902:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f214fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec033 expref: 61 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.108923:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.108929:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.109016:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261360896:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 170us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.109025:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789578993.118776:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.119496:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361024 00000100:00100000:1.0:1789578993.119510:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361024 00000100:00100000:1.0:1789578993.119587:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:1.0:1789578993.119598:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261361024:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:1.0:1789578993.119738:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.119770:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.119784:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789578993.119916:0:9792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789578993.120020:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261361024:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 423us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.120028:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:3.0:1789578993.123080:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.123191:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361152 00000100:00100000:0.0:1789578993.123204:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361152 00000100:00100000:0.0:1789578993.123267:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:0.0:1789578993.123278:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+60:11374:x1876509261361152:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578993.123303:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.123327:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec06b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123490:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123502:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123525:0:6492:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123539:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123555:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.123558:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789578993.123563:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.123571:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436400, rc 0) 00000100:00100000:0.0:1789578993.123647:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+61:11374:x1876509261361152:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 371us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.123654:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000040:00080000:2.0:1789578993.187684:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789578993.187697:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789578993.187759:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789578993.187773:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789578993.188067:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277157120:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789578993.188203:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58180 going to sleep for 11 seconds 00000100:00100000:2.0:1789578993.194927:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277157120:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789578993.198234:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.198604:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361280 00000100:00100000:0.0:1789578993.198617:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361280 00000100:00100000:0.0:1789578993.198698:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:0.0:1789578993.198709:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+61:11375:x1876509261361280:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789578993.198753:0:13782:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789578993.198917:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+61:11375:x1876509261361280:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 209us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.198925:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:3.0:1789578993.202724:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.203785:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361408 00000100:00100000:2.0:1789578993.203821:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361408 00000100:00100000:2.0:1789578993.203910:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:2.0:1789578993.203924:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+61:11375:x1876509261361408:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.204024:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204045:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204060:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204080:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204087:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204117:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204147:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204156:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204163:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578993.204223:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789578993.204228:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578993.204245:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204257:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204265:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204273:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204280:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.204285:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.204293:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205903:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:2.0:1789578993.205917:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578993.205931:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205942:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f215c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205970:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205978:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205985:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.205991:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.205995:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206002:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206018:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9394091b5d00) 00010000:00010000:2.0:1789578993.206020:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578993.206023:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206028:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f215cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206072:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206078:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206084:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206088:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.206091:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206097:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206104:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.206107:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578993.206109:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.206115:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f215d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.206258:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+61:11375:x1876509261361408:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 2331us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.206269:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:3.0:1789578993.209007:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.211162:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361664 00000100:00100000:1.0:1789578993.211184:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361664 00000100:00100000:1.0:1789578993.211333:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:1.0:1789578993.211346:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+61:11375:x1876509261361664:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789578993.211396:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789578993.211424:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f215da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec072 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211564:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211583:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211599:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789578993.211613:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789578993.211725:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211751:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211758:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211765:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.211770:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211779:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211802:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578993.211806:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789578993.211813:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211820:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f215e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211871:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f215da lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec072 expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211882:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789578993.211885:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789578993.211888:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f215da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec072 expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.211899:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789578993.211992:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261361664:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 648us (2998us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789578993.212000:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:2.0:1789578993.215945:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.216028:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261361792 00000100:00100000:1.0:1789578993.216041:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261361792 00000100:00100000:1.0:1789578993.216119:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:1.0:1789578993.216131:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261361792:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789578993.216183:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789578993.216406:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261361792:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 276us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.216415:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:3.0:1789578993.219151:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.219279:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362048 00000100:00100000:0.0:1789578993.219292:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362048 00000100:00100000:0.0:1789578993.219429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:0.0:1789578993.219444:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261362048:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789578993.219477:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.219481:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789578993.219515:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2157f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec056 expref: 62 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.219541:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578993.219547:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789578993.219563:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f215ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec079 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789578993.220628:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789578993.220839:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f215f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.220858:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f215f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.220893:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f215f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.220972:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f215ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec079 expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.220993:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f215f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec079 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.221002:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0f700) 00010000:00010000:0.0:1789578993.221005:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789578993.221009:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437a00, rc 0) 00000100:00100000:0.0:1789578993.221090:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+63:11375:x1876509261362048:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1648us (1952us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789578993.221099:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:3.0:1789578993.225487:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.226115:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362304 00000100:00100000:1.0:1789578993.226133:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362304 00000100:00100000:1.0:1789578993.226259:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:1.0:1789578993.226271:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+63:11375:x1876509261362304:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789578993.226395:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578993.226431:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f215f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec079 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226454:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0f700) 00010000:00010000:1.0:1789578993.226467:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789578993.226494:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226510:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226521:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226710:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226732:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226746:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226811:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226819:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226826:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226832:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.226837:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226845:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226856:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789578993.226859:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.226864:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.226871:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21604 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227110:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227118:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227124:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227130:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.227132:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227138:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227146:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9b6cfb16 (ffff939410126600) 00010000:00010000:1.0:1789578993.227149:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.227151:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.227157:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2160b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9b6cfb16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.227256:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261362304:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 983us (1778us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789578993.227265:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:3.0:1789578993.230068:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.230145:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362432 00000100:00100000:0.0:1789578993.230157:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362432 00000100:00100000:0.0:1789578993.230236:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:0.0:1789578993.230248:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+62:11375:x1876509261362432:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789578993.230274:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.230302:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f21612 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec080 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230390:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230407:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230440:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230572:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f21612 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 64 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230592:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 63 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.230602:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:0.0:1789578993.230605:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789578993.230609:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789578993.231216:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+63:11375:x1876509261362432:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 966us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.231226:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:3.0:1789578993.235070:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.235549:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362688 00000100:00100000:0.0:1789578993.235564:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362688 00000100:00100000:0.0:1789578993.235674:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:0.0:1789578993.235687:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+63:11375:x1876509261362688:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789578993.235810:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.235833:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.235847:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789578993.236083:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1789578993.236151:0:13782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb2a4ab reply state 00000000e51c24fb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.236165:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.236174:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:0.0:1789578993.236177:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789578993.236183:0:13782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789578993.236337:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+65:11375:x1876509261362688:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 651us (1280us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789578993.236346:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 131 00000100:00100000:3.0:1789578993.238600:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.239102:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362816 00000100:00100000:2.0:1789578993.239116:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362816 00000100:00100000:2.0:1789578993.239213:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:2.0:1789578993.239225:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+65:11375:x1876509261362816:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.239259:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578993.239286:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec087 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.239481:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 66 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.239500:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 66 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.239523:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:2.0:1789578993.239527:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789578993.239531:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789578993.239602:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+66:11375:x1876509261362816:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 378us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.239609:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:3.0:1789578993.241838:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.241930:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261362944 00000100:00100000:0.0:1789578993.241943:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261362944 00000100:00100000:2.0:1789578993.242116:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789578993.242130:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261362944:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789578993.242583:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261362944:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 454us (756us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789578993.242591:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789578993.245667:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.245778:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261363200 00000100:00100000:1.0:1789578993.245802:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261363200 00000100:00100000:1.0:1789578993.245896:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789578993.245927:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+66:11375:x1876509261363200:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789578993.246208:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+67:11375:x1876509261363200:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 284us (552us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789578993.246217:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:3.0:1789578993.248505:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.249580:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261363456 00000100:00100000:0.0:1789578993.249598:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261363456 00000100:00100000:0.0:1789578993.249686:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:0.0:1789578993.249699:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+67:11375:x1876509261363456:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789578993.249863:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+67:11375:x1876509261363456:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 166us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.249871:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:3.0:1789578993.255663:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.255881:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261363584 00000100:00100000:2.0:1789578993.255895:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261363584 00000100:00100000:2.0:1789578993.255974:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:2.0:1789578993.256002:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+67:11375:x1876509261363584:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.256035:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578993.256073:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f2162e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec08e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256176:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256193:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256207:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578993.256266:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789578993.256289:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256333:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aec00/0xd90373d592f2162e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec08e expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256568:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec08e expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.256580:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:2.0:1789578993.256584:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789578993.256589:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789578993.256669:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+68:11375:x1876509261363584:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 669us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.256689:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:1.0:1789578993.260160:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.260254:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261363712 00000100:00100000:2.0:1789578993.260267:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261363712 00000100:00100000:2.0:1789578993.260384:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789578993.260401:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261363712:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.260425:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578993.260460:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec095 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789578993.260493:0:10029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaacef0, blocks: 0x0 00010000:00010000:2.0:1789578993.260521:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789578993.260526:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578993.260537:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 10 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.260560:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 10 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.260576:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789578993.260651:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+10:2395:x1876509261363712:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 252us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.260658:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:3.0:1789578993.265339:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.265534:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261363968 00000100:00100000:1.0:1789578993.265547:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261363968 00000100:00100000:1.0:1789578993.265625:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:1.0:1789578993.265637:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+68:11375:x1876509261363968:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789578993.265785:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+68:11375:x1876509261363968:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 150us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.265803:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:3.0:1789578993.269557:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.269685:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364096 00000100:00100000:2.0:1789578993.269699:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364096 00000100:00100000:2.0:1789578993.269779:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789578993.269806:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+10:11375:x1876509261364096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.269851:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578993.269874:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec09c expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.269914:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.269923:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578993.269928:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578993.269934:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.269974:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.269989:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.270006:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1876509277157248:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578993.270872:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58180 going to sleep for 11 seconds 00000100:00100000:1.0:1789578993.274348:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1876509277157248:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789578993.274455:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.274483:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:1.0:1789578993.274562:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+11:11375:x1876509261364096:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 4771us (5018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.274573:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:3.0:1789578993.278941:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.279088:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364224 00000100:00100000:1.0:1789578993.279102:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364224 00010000:00010000:1.0:1789578993.279159:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.279235:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:1.0:1789578993.279248:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+11:2394:x1876509261364224:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578993.279270:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578993.279301:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.279541:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.279574:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae693b1/0xd90373d592f2163c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec095 expref: 11 pid: 10029 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.279597:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789578993.279602:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789578993.279611:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.279623:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.279674:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.279693:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1876509277157376:192.168.203.37@tcp:105: 00000100:00100000:1.0:1789578993.279937:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.286084:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.286177:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364352 00000100:00100000:3.0:1789578993.286189:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364352 00002000:00100000:3.0:1789578993.286258:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff939402aa5180 x1876509261364352/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:239/0 lens 504/0 e 0 to 0 dl 1789579004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789578993.286271:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939402aa5180 with x1876509261364352 ext(0->12) 00002000:00010000:3.0:1789578993.286279:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939402aa5180 00000100:00100000:3.0:1789578993.286331:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789578993.286343:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+11:2394:x1876509261364352:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789578993.287054:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6477:1876509277157376:192.168.203.37@tcp:105: 00010000:00010000:1.0:1789578993.287082:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578993.287156:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+13:2394:x1876509261364224:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 7911us (8230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.287167:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:0.0:1789578993.288804:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+12:2394:x1876509261364352:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 2441us (2713us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789578993.288819:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00002000:00100000:0.0:1789578993.288856:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff939402aa5180 x1876509261364352/t4294967309(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:239/0 lens 504/448 e 0 to 0 dl 1789579004 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789578993.288869:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939402aa5180 with x1876509261364352 ext(0->12) 00002000:00010000:0.0:1789578993.288876:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939402aa5180 00000100:00100000:1.0:1789578993.294717:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.294817:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364480 00000100:00100000:2.0:1789578993.294832:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364480 00000100:00100000:2.0:1789578993.294909:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:2.0:1789578993.294921:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+68:11375:x1876509261364480:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789578993.297613:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:1.0:1789578993.297746:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297759:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297767:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297773:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.297778:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297797:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297815:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939432168e00) 00010000:00010000:1.0:1789578993.297818:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.297823:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297830:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21348 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297873:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297880:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297886:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297891:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.297894:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297900:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297908:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9394039cea00) 00010000:00010000:1.0:1789578993.297911:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.297914:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297920:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f213f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297936:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297942:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297947:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297961:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.297964:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297970:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297978:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:1.0:1789578993.297980:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.297983:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.297989:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2146e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298000:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298011:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298017:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298022:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.298024:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298030:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298049:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9394091b5100) 00010000:00010000:1.0:1789578993.298052:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.298055:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298060:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21491 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298077:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298084:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298090:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298094:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.298097:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298102:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298176:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578993.298182:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789578993.298186:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298192:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21563 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298214:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298220:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298226:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298231:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789578993.298234:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298240:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298247:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:1.0:1789578993.298249:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789578993.298252:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.298257:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21620 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789578993.298298:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789578993.298328:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939302a95300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789578993.298332:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939429030d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93940305a480 00000020:00080000:3.0:1789578993.298335:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939429030100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939303b95400 00000020:00080000:2.0:1789578993.298409:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:3.0:1789578993.298609:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789578993.298644:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939303460300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789578993.298648:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939420265f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939303460480 00000020:00080000:3.0:1789578993.298651:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939420265100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939303aabc00 00000020:00080000:3.0:1789578993.298666:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1789578993.298669:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789578993.298683:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789578993.298744:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789578993.298878:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+16:11375:x1876509261364480:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 3954us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578993.298887:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:1.0:1789578993.299128:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789578993.299144:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277157504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789578993.299193:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578993.300895:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578993.300910:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277157632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789578993.300954:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578993.300991:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277157504 00000100:00100000:0.0:1789578993.300997:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277157504 00000100:00100000:0.0:1789578993.301032:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277157632 00000100:00100000:0.0:1789578993.301035:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277157632 00000100:00100000:0.0:1789578993.301061:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578993.301079:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3615:x1876509277157504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789578993.301129:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1789578993.301158:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aaaceef, atime: 0x6aaaceef, ctime: 0x6aaaceef, blocks: 0x8 00010000:00010000:0.0:1789578993.301165:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301179:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1789578993.301183:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789578993.301189:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301203:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301213:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301227:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301243:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789578993.301408:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3615:x1876509277157504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 331us (2214us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789578993.301415:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789578993.301434:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789578993.301440:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277157632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789578993.301452:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789578993.301465:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301480:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301487:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789578993.301490:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789578993.301494:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301519:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301533:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 11 pid: 8403 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.301552:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277157760:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578993.301605:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405765240 going to sleep for 11 seconds 00000100:00080000:0.0:1789578993.301618:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789578993.301628:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578993.301633:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301641:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578993.301645:0:10313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301654:0:10313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301669:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301676:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008563646b/0xd90373d592f2164a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.301693:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578993.301695:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578993.301696:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789578993.301725:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939437207b80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789578993.301731:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277157504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789578993.302260:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.302532:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364608 00000100:00100000:1.0:1789578993.302537:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364608 00000100:00100000:1.0:1789578993.302562:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789578993.302576:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+12:2395:x1876509261364608:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789578993.304677:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.304739:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364736 00000100:00100000:1.0:1789578993.304746:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364736 00010000:00010000:1.0:1789578993.304778:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 13 pid: 8403 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.304829:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:1.0:1789578993.304839:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+13:2394:x1876509261364736:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578993.304853:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578993.304860:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 13 pid: 8403 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.304873:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 13 pid: 8403 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.304896:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578993.304900:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578993.304905:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.304914:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.304932:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578993.304982:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+13:2394:x1876509261364736:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 144us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.305000:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00010000:00010000:2.0:1789578993.305574:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe045ca7/0xd90373d592f213fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebff4 expref: 12 pid: 8403 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.305592:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277157760:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578993.305615:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.305626:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.305634:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.305644:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.305652:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.305670:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789578993.305827:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277157632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4386us (4872us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789578993.305835:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789578993.305935:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789578993.305943:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.305952:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789578993.305956:0:10312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.305965:0:10312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.305979:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.305986:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a9d201/0xd90373d592f21651 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.306012:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578993.306014:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578993.306015:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789578993.306091:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939402aa4e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789578993.306102:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277157632:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789578993.306889:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789578993.306909:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1789578993.307259:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261364608:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 4681us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.307269:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789578993.309930:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.310025:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261364992 00000100:00100000:3.0:1789578993.310034:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261364992 00000100:00100000:3.0:1789578993.310344:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:3.0:1789578993.310384:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+16:11375:x1876509261364992:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789578993.310437:0:13782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789578993.310464:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21635 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec08e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.310546:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:3.0:1789578993.310552:0:13782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789578993.310585:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.310600:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.310611:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789578993.310735:0:13782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fb964c1 reply state 00000000051714a6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.310749:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.310770:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:3.0:1789578993.310773:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789578993.310776:0:13782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789578993.310935:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+17:11375:x1876509261364992:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 553us (1011us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1789578993.310943:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:2.0:1789578993.316239:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.316403:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261365120 00000100:00100000:3.0:1789578993.316414:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261365120 00000100:00100000:3.0:1789578993.316503:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:3.0:1789578993.316513:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261365120:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789578993.316651:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789578993.316656:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789578992 00002000:00010000:3.0:1789578993.316658:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789578991 00002000:00010000:3.0:1789578993.316660:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789578992 -> 1789578992 00002000:00010000:3.0:1789578993.316663:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789578993.316721:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261365120:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 209us (490us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789578993.316729:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789578993.320041:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.320268:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261365376 00000100:00100000:2.0:1789578993.320277:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261365376 00000100:00100000:2.0:1789578993.320420:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:2.0:1789578993.320430:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+17:11375:x1876509261365376:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.320491:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.320508:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.320517:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.320550:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.320564:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 17 pid: 6490 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.320578:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277157888:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578993.320668:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58600 going to sleep for 11 seconds 00000100:00100000:2.0:1789578993.323715:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277157888:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578993.323745:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.325246:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.332039:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261365504 00000100:00100000:3.0:1789578993.332059:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261365504 00010000:00010000:2.0:1789578993.334991:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 18 pid: 6490 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.335069:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:2.0:1789578993.335083:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+18:2394:x1876509261365504:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578993.335126:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.335135:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 18 pid: 6490 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335152:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 18 pid: 6490 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335180:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21619 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec080 expref: 18 pid: 6490 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335202:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:2.0:1789578993.335208:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335218:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335226:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.335258:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.335399:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+17:2394:x1876509261365504:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 319us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.335408:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00010000:00010000:0.0:1789578993.339809:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339831:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339890:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339898:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339907:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339913:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578993.339918:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339925:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339947:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:0.0:1789578993.339973:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789578993.339981:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.339988:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2165f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.340134:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+16:11375:x1876509261365376:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 19698us (20095us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789578993.340144:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:3.0:1789578993.342760:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.342872:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261365632 00000100:00100000:2.0:1789578993.342886:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261365632 00000100:00100000:2.0:1789578993.343025:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:2.0:1789578993.343038:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261365632:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789578993.343123:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.343147:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.343157:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578993.343161:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789578993.343166:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.343214:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.343232:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 7 pid: 8404 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.343249:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277158016:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789578993.343618:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58600 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.347939:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.348113:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1876509277158016:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578993.348151:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.348247:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261365760 00000100:00100000:1.0:1789578993.348256:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261365760 00010000:00010000:1.0:1789578993.348303:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 8 pid: 8404 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789578993.348389:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:1.0:1789578993.348401:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261365760:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578993.348420:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578993.348447:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 8 pid: 8404 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.348463:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 8 pid: 8404 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.348493:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f21643 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec09c expref: 8 pid: 8404 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.348511:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578993.348517:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789578993.348523:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.348559:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.348593:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578993.348661:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261365760:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 261us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.348669:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00010000:00010000:0.0:1789578993.351548:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351575:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351617:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351626:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351636:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351644:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aec00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578993.351650:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351686:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351712:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.351722:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f21666 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.351894:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261365632:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 8850us (9139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.351905:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:0.0:1789578993.356251:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.356621:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366016 00000100:00100000:3.0:1789578993.356635:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366016 00000100:00100000:3.0:1789578993.356763:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:3.0:1789578993.356774:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+16:11375:x1876509261366016:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789578993.356914:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.356959:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 16 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.356972:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.357016:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 16 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.357031:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 16 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.357051:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158144:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789578993.357188:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298300 going to sleep for 11 seconds 00000100:00100000:2.0:1789578993.361085:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158144:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789578993.361129:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.362677:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.362780:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366144 00000100:00100000:2.0:1789578993.362802:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366144 00010000:00010000:2.0:1789578993.362870:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.362919:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:2.0:1789578993.362931:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+17:2395:x1876509261366144:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578993.362952:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.362959:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.362974:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363000:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2155c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec048 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363023:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.363031:0:9492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363043:0:9492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363051:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363082:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.363124:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.363199:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+16:2395:x1876509261366144:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 269us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.363207:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00010000:00010000:3.0:1789578993.364069:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364085:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364348:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364396:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 16 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364404:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364468:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 16 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.364486:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 16 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.364502:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158272:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789578993.364599:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298480 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.368542:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.368646:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366272 00000100:00100000:2.0:1789578993.368659:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366272 00010000:00010000:2.0:1789578993.368712:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.368772:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:2.0:1789578993.368785:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+17:2395:x1876509261366272:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578993.368819:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.368836:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.368852:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 17 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.368883:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:2.0:1789578993.368889:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.368900:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.368932:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.368957:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.369027:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+17:2395:x1876509261366272:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 243us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.369034:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00010000:00010000:3.0:1789578993.370675:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21627 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec087 expref: 16 pid: 9792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.370711:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158272:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789578993.370747:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.370759:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578993.370764:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789578993.370996:0:9792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789578993.371154:0:9792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789578993.371202:0:9792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789578993.371558:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9792:1876509277158400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789578993.371740:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578993.371835:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437298a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789578993.372021:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277158400 00000100:00100000:3.0:1789578993.372031:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277158400 00000100:00100000:3.0:1789578993.372185:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789578993.372197:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9792:x1876509277158400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789578993.372329:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9792:x1876509277158400:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578993.372338:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789578993.372461:0:9792:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1789578993.372468:0:9792:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1789578993.372503:0:9792:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff939402aa4e00 x1876509277157632/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789579009 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578993.372517:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9792:1876509277158400:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789578993.372686:0:9792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789578993.372766:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9792:1876509277158528:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789578993.372818:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578993.373291:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.373601:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277158528 00000100:00100000:0.0:1789578993.373610:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277158528 00000100:00100000:0.0:1789578993.373663:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789578993.373672:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9792:x1876509277158528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789578993.373929:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9792:x1876509277158528:12345-0@lo:1000:mdt00_003.0 Request processed in 257us (1109us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789578993.373937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789578993.374663:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9792:1876509277158528:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789578993.374731:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.374744:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.374752:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376843:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.376866:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376884:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376909:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:2.0:1789578993.376913:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789578993.376919:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376927:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21674 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376977:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376986:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376993:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.376999:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.377002:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.377008:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.377048:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.377051:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789578993.377062:0:9792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.377075:0:9792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.377086:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.377147:0:9792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.377165:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158656:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789578993.377408:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789578993.384102:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.384232:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277158656:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789578993.384275:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384289:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f215b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384385:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384403:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384437:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384450:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384457:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384464:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384471:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.384476:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384484:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384498:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.384502:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789578993.384507:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384513:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2167b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384526:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384533:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384550:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384555:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789578993.384559:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384566:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384577:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.384579:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789578993.384582:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.384588:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2166d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.384821:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+19:11375:x1876509261366016:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 28046us (28584us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789578993.384834:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 139 00000020:00080000:2.0:1789578993.384843:0:9792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789578993.385129:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789578993.385135:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789578993.385678:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789578993.385690:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789578993.386386:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366400 00000100:00100000:1.0:1789578993.386400:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366400 00000100:00100000:1.0:1789578993.386477:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:1.0:1789578993.386489:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+19:11374:x1876509261366400:12345-192.168.203.37@tcp:49:lfs.0 00000100:00100000:1.0:1789578993.386656:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+19:11374:x1876509261366400:12345-192.168.203.37@tcp:49:lfs.0 Request processed in 168us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578993.386663:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:3.0:1789578993.391874:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578993.391937:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.392118:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366912 00000100:00100000:2.0:1789578993.392133:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366912 00000100:00100000:2.0:1789578993.392220:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:2.0:1789578993.392233:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+19:11374:x1876509261366912:12345-192.168.203.37@tcp:58:lfs.0 00000100:00100000:1.0:1789578993.392602:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261366656 00000100:00100000:1.0:1789578993.392608:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261366656 00000100:00100000:1.0:1789578993.392651:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789578993.392660:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b602050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+20:11375:x1876509261366656:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789578993.393020:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789578993.393064:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789578993.393107:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393128:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393158:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393168:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393176:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393183:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578993.393211:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789578993.393342:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b602050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+22:11375:x1876509261366656:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 681us (1481us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789578993.393387:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000020:00080000:1.0:1789578993.393395:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789578993.393849:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789578993.393909:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+21:11374:x1876509261366912:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 1678us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.393932:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 140 00010000:00010000:0.0:1789578993.394692:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789578993.394703:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.394714:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789578993.394719:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.394731:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.394754:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:0.0:1789578993.394758:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789578993.394764:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.394770:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f21682 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.394795:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578993.394798:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789578993.394800:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789578993.423685:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578993.423848:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367040 00000100:00100000:0.0:1789578993.423863:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367040 00000100:00100000:0.0:1789578993.423972:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:0.0:1789578993.423985:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:11377:x1876509261367040:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789578993.424029:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789578993.424061:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21689 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0a3 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424187:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424208:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424223:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424241:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424248:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424255:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424436:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424450:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424460:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424502:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.424532:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 22 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578993.424549:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277158784:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789578993.424654:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394057659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789578993.430286:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578993.430410:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367296 00000100:00100000:1.0:1789578993.430423:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367296 00000100:00100000:1.0:1789578993.430501:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:1.0:1789578993.430514:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+23:6162:x1876509261367296:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789578993.430860:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+24:6162:x1876509261367296:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 348us (588us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789578993.430869:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:0.0:1789578993.431173:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277158784:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789578993.431210:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789578993.432817:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578993.433171:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367424 00000100:00100000:2.0:1789578993.433185:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367424 00010000:00010000:2.0:1789578993.433239:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 24 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578993.433292:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:2.0:1789578993.433303:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+24:2395:x1876509261367424:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789578993.436491:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789578993.436521:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 24 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436545:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 24 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436577:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f215a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec064 expref: 24 pid: 13782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436602:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578993.436609:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436621:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436631:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578993.436691:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789578993.436804:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+23:2395:x1876509261367424:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 3484us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578993.436817:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00010000:00010000:0.0:1789578993.437799:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.437816:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789578993.437901:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789578993.437907:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789578993.437934:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.437952:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.437962:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.437970:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.437998:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438005:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578993.438011:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438019:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438034:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:0.0:1789578993.438037:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578993.438041:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438048:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438064:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438071:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438077:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438081:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578993.438084:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438105:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438115:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939412b0f600) 00010000:00010000:0.0:1789578993.438117:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578993.438121:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438127:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438177:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21689 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0a3 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438192:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0a3 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578993.438200:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578993.438202:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789578993.438205:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437800, rc 0) 00000100:00100000:0.0:1789578993.438277:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+22:11377:x1876509261367040:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 14294us (14617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578993.438286:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 141 00010000:00010000:1.0:1789578993.827930:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789578994.215662:0:14236:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789578994.215672:0:14236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789578994.215704:0:14236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789578994.215709:0:14236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789578994.407589:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789578994.407598:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789578994.407623:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789578994.407629:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789578994.407751:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277158912:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789578994.407853:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789578994.415966:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578994.416086:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367552 00000100:00100000:3.0:1789578994.416096:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367552 00000100:00100000:3.0:1789578994.416165:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:3.0:1789578994.416177:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+23:11390:x1876509261367552:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789578994.416208:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789578994.416314:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+23:11390:x1876509261367552:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 140us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578994.416321:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:2.0:1789578994.416500:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277158912:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1789578994.416693:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789578994.422897:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578994.423295:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367808 00000100:00100000:2.0:1789578994.423305:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367808 00000100:00100000:2.0:1789578994.423399:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 143 00000100:00100000:2.0:1789578994.423410:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+22:11390:x1876509261367808:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789578994.423430:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578994.423452:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f216a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0aa expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578994.423565:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f216ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578994.423608:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f216ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578994.423622:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f216ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789578994.423634:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789578994.423736:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f216a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0aa expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578994.423755:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f216ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0aa expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578994.423763:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:2.0:1789578994.423766:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789578994.423770:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789578994.423837:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+24:11390:x1876509261367808:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 428us (948us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789578994.423844:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 143 00000100:00100000:2.0:1789578994.429877:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578994.429989:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261367936 00000100:00100000:1.0:1789578994.429999:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261367936 00000100:00100000:1.0:1789578994.430072:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:1.0:1789578994.430084:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+24:2395:x1876509261367936:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789578994.430099:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789578994.430121:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f216ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0aa expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789578994.430137:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789578994.430142:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789578994.430196:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+23:2395:x1876509261367936:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578994.430204:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:1.0:1789578994.433705:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578994.434464:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368192 00000100:00100000:0.0:1789578994.434474:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368192 00000100:00100000:0.0:1789578994.434533:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:0.0:1789578994.434543:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+23:11390:x1876509261368192:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789578994.434702:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434721:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434734:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434887:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434895:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434902:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434908:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578994.434912:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434920:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434932:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578994.434935:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789578994.434940:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578994.434947:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f216ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578994.435088:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930412ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+24:11390:x1876509261368192:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 545us (1390us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789578994.435097:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 144 00000040:00080000:2.0:1789578994.435220:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789578994.435225:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789578994.435849:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789578994.435858:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789578994.449323:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578994.449511:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368448 00000100:00100000:1.0:1789578994.449521:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368448 00000100:00100000:1.0:1789578994.449585:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:1.0:1789578994.449596:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+24:11390:x1876509261368448:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789578994.449823:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+25:11390:x1876509261368448:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 227us (520us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789578994.449831:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00010000:00010000:2.0:1789578994.851839:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789578995.048866:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789578995.048887:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1789578995.323989:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324150:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324189:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324222:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324240:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324261:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324296:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789578995.324337:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368832 00000100:00100000:1.0:1789578995.324347:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368832 00000100:00100000:1.0:1789578995.324414:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369344 00000100:00100000:1.0:1789578995.324418:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369344 00000100:00100000:1.0:1789578995.324433:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368704 00000100:00100000:1.0:1789578995.324436:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368704 00000100:00100000:1.0:1789578995.324447:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369216 00000100:00100000:1.0:1789578995.324449:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369216 00000100:00100000:1.0:1789578995.324466:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 276 00000100:00100000:1.0:1789578995.324475:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261368832:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578995.324544:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261368832:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 69us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578995.324552:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 276 00000100:00100000:1.0:1789578995.324569:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 277 00000100:00100000:1.0:1789578995.324576:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261369344:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578995.324600:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261369344:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578995.324605:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 277 00000100:00100000:1.0:1789578995.324616:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 278 00000100:00100000:1.0:1789578995.324621:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+25:2392:x1876509261368704:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578995.324646:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+25:2392:x1876509261368704:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578995.324651:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 278 00000100:00100000:1.0:1789578995.324661:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 279 00000100:00100000:1.0:1789578995.324666:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261369216:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789578995.324705:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261369216:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789578995.324717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 279 00000100:00080000:1.0:1789578995.324752:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789578995.324756:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789578995.326124:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369088 00000100:00100000:3.0:1789578995.326136:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369088 00000100:00100000:3.0:1789578995.326198:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368960 00000100:00100000:3.0:1789578995.326202:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368960 00000100:00100000:3.0:1789578995.326234:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:3.0:1789578995.326243:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261369088:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578995.326325:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261369088:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 83us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578995.326333:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:3.0:1789578995.326378:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:3.0:1789578995.326386:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261368960:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789578995.326411:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2392:x1876509261368960:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578995.326417:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00080000:1.0:1789578995.327258:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789578995.327325:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789578995.327669:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261368576 00000100:00100000:0.0:1789578995.327677:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261368576 00000100:00100000:0.0:1789578995.327976:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 379 00000100:00100000:0.0:1789578995.327986:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261368576:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789578995.328179:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261368576:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 193us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578995.328187:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 379 00010000:00010000:0.0:1789578995.875571:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789578995.974785:0:14287:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789578995.974795:0:14287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789578995.974839:0:14287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789578995.974845:0:14287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1789578996.068230:0:8663:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351200876710ns, next at 352200874501ns, rc = 0 00000100:00100000:0.0:1789578996.068315:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277159040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789578996.068391:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578996.068451:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277159168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789578996.068473:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072197:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277159680:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072257:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072297:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277160192:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072322:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072362:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277160704:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072417:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789578996.072423:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277159296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578996.072444:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072460:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277159808:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072479:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072494:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277160320:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072512:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072543:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277159552:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072563:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072579:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277160064:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072604:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072620:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277160576:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072639:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072656:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789578996.072661:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277159424:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072684:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072703:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277159936:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072736:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277160448:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072754:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.072796:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159680 00000100:00100000:2.0:1789578996.072803:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159680 00000100:00100000:2.0:1789578996.072839:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159936 00000100:00100000:2.0:1789578996.072842:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159936 00000100:00100000:2.0:1789578996.072856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789578996.072863:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277159680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072909:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277159680:12345-0@lo:400:kworker.0 Request processed in 46us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.072916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789578996.072931:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789578996.072937:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277159936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.072962:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277159936:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.072968:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789578996.072983:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160704 00000100:00100000:2.0:1789578996.072986:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160704 00000100:00100000:2.0:1789578996.073016:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160576 00000100:00100000:2.0:1789578996.073019:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160576 00000100:00100000:2.0:1789578996.073037:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789578996.073042:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277160704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073068:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277160704:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073074:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789578996.073084:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789578996.073090:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277160576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073113:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277160576:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073127:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789578996.073145:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159040 00000100:00100000:2.0:1789578996.073149:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159040 00000100:00100000:2.0:1789578996.073165:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159168 00000100:00100000:2.0:1789578996.073168:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159168 00000100:00100000:2.0:1789578996.073176:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159296 00000100:00100000:2.0:1789578996.073178:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159296 00000100:00100000:2.0:1789578996.073188:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789578996.073193:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277159040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789578996.073212:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789578996.073241:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277159040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073246:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789578996.073258:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789578996.073263:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277159168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789578996.073272:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789578996.073293:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277159168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073298:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789578996.073308:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789578996.073314:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277159296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789578996.073326:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789578996.073366:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277159296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073372:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789578996.073388:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160192 00000100:00100000:2.0:1789578996.073396:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160192 00000100:00100000:2.0:1789578996.073417:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159808 00000100:00100000:2.0:1789578996.073419:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159808 00000100:00100000:2.0:1789578996.073428:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160320 00000100:00100000:2.0:1789578996.073430:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160320 00000100:00100000:2.0:1789578996.073442:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159552 00000100:00100000:2.0:1789578996.073444:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159552 00000100:00100000:2.0:1789578996.073454:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160064 00000100:00100000:2.0:1789578996.073455:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160064 00000100:00100000:2.0:1789578996.073467:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160448 00000100:00100000:2.0:1789578996.073470:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160448 00000100:00100000:2.0:1789578996.073483:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789578996.073488:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277160192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073517:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277160192:12345-0@lo:400:kworker.0 Request processed in 29us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073522:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789578996.073534:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789578996.073540:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277159808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073562:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277159808:12345-0@lo:400:kworker.0 Request processed in 23us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073567:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789578996.073577:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789578996.073582:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277160320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073604:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277160320:12345-0@lo:400:kworker.0 Request processed in 22us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073608:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789578996.073619:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789578996.073624:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277159552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073659:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277159552:12345-0@lo:400:kworker.0 Request processed in 34us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073665:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789578996.073675:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789578996.073681:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277160064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073704:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277160064:12345-0@lo:400:kworker.0 Request processed in 23us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073710:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789578996.073720:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789578996.073726:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277160448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073748:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277160448:12345-0@lo:400:kworker.0 Request processed in 23us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073753:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789578996.073794:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277159424 00000100:00100000:2.0:1789578996.073798:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277159424 00000100:00100000:2.0:1789578996.073823:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789578996.073829:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277159424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.073856:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277159424:12345-0@lo:400:kworker.0 Request processed in 27us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.073862:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:2.0:1789578996.073889:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789578996.073892:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789578996.073895:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789578996.073897:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789578996.073924:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789578996.073930:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1789578996.073954:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93940f40d180, transno 4294967302 00000004:00080000:2.0:1789578996.073963:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789578996.073974:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939437207b80, transno 4294967305 00000100:00100000:2.0:1789578996.073984:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277159296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789578996.073998:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277159808:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074005:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277160320:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074014:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277159680:0@lo:400:kworker.0 00010000:00080000:2.0:1789578996.074024:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489dc00 x1876509277160192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578996.074034:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277160192:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074042:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277160704:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074054:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277159168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789578996.074187:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277159424:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074197:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277159936:0@lo:400:kworker.0 00010000:00080000:2.0:1789578996.074205:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930489c000 x1876509277160448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789578996.074214:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277160448:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074221:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277159552:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074229:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277160064:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074238:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277160576:0@lo:400:kworker.0 00000100:00100000:2.0:1789578996.074263:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277159040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789578996.075760:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789578996.075786:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277160832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789578996.075837:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578996.075873:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160832 00000100:00100000:2.0:1789578996.075879:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160832 00000100:00100000:2.0:1789578996.075910:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789578996.075917:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277160832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789578996.076258:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789578996.076377:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277160832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 458us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789578996.076384:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789578996.076558:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277160832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789578996.244750:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789578996.244803:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369600 00000100:00100000:3.0:1789578996.244812:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369600 00000100:00100000:3.0:1789578996.244879:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 145 00000100:00100000:3.0:1789578996.244889:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+25:11410:x1876509261369600:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789578996.244909:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789578996.244928:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0b1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578996.245033:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f216c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578996.245047:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f216c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578996.245060:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f216c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789578996.245077:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789578996.245181:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b1 expref: 28 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578996.245197:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f216c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b1 expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789578996.245206:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:3.0:1789578996.245209:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789578996.245212:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36600, rc 0) 00000100:00100000:3.0:1789578996.245266:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+27:11410:x1876509261369600:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 378us (521us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789578996.245274:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 145 00000100:00080000:3.0:1789578996.245307:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789578996.268481:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789578996.268541:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369728 00000100:00100000:0.0:1789578996.268553:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369728 00000100:00100000:0.0:1789578996.268615:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:0.0:1789578996.268634:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+27:11410:x1876509261369728:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:0.0:1789578996.268698:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268722:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268734:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268782:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268790:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268798:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268804:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578996.268809:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268816:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268828:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789578996.268831:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789578996.268837:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578996.268843:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f216d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789578996.268927:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+27:11410:x1876509261369728:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 302us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578996.268941:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:3.0:1789578996.353518:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578996.353814:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369856 00000100:00100000:2.0:1789578996.353833:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369856 00000100:00100000:2.0:1789578996.353896:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789578996.353906:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261369856:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789578996.353923:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789578996.353951:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f216dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0b8 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789578996.353977:0:10029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aaacef0, atime: 0x6aaaceef, ctime: 0x6aaacef0, blocks: 0x8 00010000:00010000:2.0:1789578996.353997:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1789578996.354002:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789578996.354011:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f216dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b8 expref: 7 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578996.354050:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f216dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b8 expref: 7 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789578996.354062:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789578996.354128:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2393:x1876509261369856:12345-192.168.203.37@tcp:101:cat.0 Request processed in 224us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789578996.354136:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:3.0:1789578996.359868:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789578996.359973:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261369984 00000100:00100000:2.0:1789578996.359983:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261369984 00002000:00100000:2.0:1789578996.360030:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9393043a9f80 x1876509261369984/t0(0) o3->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:242/0 lens 488/0 e 0 to 0 dl 1789579007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789578996.360043:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9393043a9f80 with x1876509261369984 ext(0->4095) 00002000:00010000:2.0:1789578996.360049:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9393043a9f80 00000100:00100000:2.0:1789578996.360082:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:2.0:1789578996.360092:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261369984:12345-192.168.203.37@tcp:3:cat.0 00000100:00100000:3.0:1789578996.360723:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261369984:12345-192.168.203.37@tcp:3:cat.0 Request processed in 630us (861us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789578996.360731:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00002000:00100000:3.0:1789578996.360739:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9393043a9f80 x1876509261369984/t0(0) o3->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:242/0 lens 488/4536 e 0 to 0 dl 1789579007 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789578996.360748:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9393043a9f80 with x1876509261369984 ext(0->4095) 00002000:00010000:3.0:1789578996.360752:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9393043a9f80 00010000:00010000:3.0:1789578996.899783:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789578997.091634:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789578997.091655:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277160960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578997.091721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578997.091816:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277160960 00000100:00100000:0.0:1789578997.091824:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277160960 00000100:00100000:0.0:1789578997.091872:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789578997.091881:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277160960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789578997.091915:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789578997.091969:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277160960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578997.091977:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789578997.092024:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277160960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789578997.092513:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789578997.092547:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789578997.092600:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161088 00000100:00100000:0.0:1789578997.092604:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161088 00000100:00100000:0.0:1789578997.092628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789578997.092635:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277161088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789578997.092655:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789578997.092691:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277161088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789578997.092697:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789578997.092729:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789578997.923614:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789578998.638591:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:1.0:1789578998.638621:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789578998.638665:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93942ef583c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789578998.638672:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939407fb6e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93942ef58600 00000020:00080000:1.0:1789578998.638676:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff939407fb6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93940137d400 00000020:00080000:1.0:1789578998.638702:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789578998.638720:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:0.0:1789578998.638835:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638851:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638866:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638874:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789578998.638879:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638888:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638910:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939412b0fa00) 00010000:00010000:0.0:1789578998.638914:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789578998.638924:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789578998.638931:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21658 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789578998.639106:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789578998.639135:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277161216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789578998.639242:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789578998.639330:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161216 00000100:00100000:2.0:1789578998.639342:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161216 00000100:00100000:2.0:1789578998.639446:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789578998.639458:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277161216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789578998.639658:0:8404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789578998.639663:0:8404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789578992 -> 1789578992 00002000:00010000:2.0:1789578998.639687:0:8404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1789578991 -> 1789578991 00002000:00010000:2.0:1789578998.639690:0:8404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789578992 -> 1789578992 00002000:00010000:2.0:1789578998.639692:0:8404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000001:00080000:3.0:1789578998.639758:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1789578998.639760:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3616:x1876509277161216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (506us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789578998.639769:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000001:00080000:3.0:1789578998.639792:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00080000:2.0:1789578998.639798:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789578998.639877:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93930486f480/2, rc 0, transno 4294967313 00000100:00100000:2.0:1789578998.639883:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277161216:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1789578998.640117:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789578998.949096:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789578999.974581:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579000.437789:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437836:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437862:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437900:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437924:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437957:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.437981:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579000.438008:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370368 00000100:00100000:1.0:1789579000.438022:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370368 00000100:00100000:1.0:1789579000.438075:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370880 00000100:00100000:1.0:1789579000.438077:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370880 00000100:00100000:1.0:1789579000.438090:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370240 00000100:00100000:1.0:1789579000.438092:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370240 00000100:00100000:1.0:1789579000.438103:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370752 00000100:00100000:1.0:1789579000.438104:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370752 00000100:00100000:1.0:1789579000.438127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 286 00000100:00100000:1.0:1789579000.438136:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261370368:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438204:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261370368:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 68us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438212:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 286 00000100:00100000:1.0:1789579000.438226:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 287 00000100:00100000:1.0:1789579000.438232:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261370880:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438252:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261370880:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 20us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438258:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 287 00000100:00100000:1.0:1789579000.438267:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 288 00000100:00100000:1.0:1789579000.438278:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+13:2394:x1876509261370240:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438297:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+13:2394:x1876509261370240:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438302:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 288 00000100:00100000:1.0:1789579000.438312:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:1.0:1789579000.438317:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261370752:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438333:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261370752:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 16us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438339:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 289 00000100:00100000:1.0:1789579000.438373:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370624 00000100:00100000:1.0:1789579000.438376:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370624 00000100:00100000:1.0:1789579000.438401:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370496 00000100:00100000:1.0:1789579000.438404:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370496 00000100:00100000:1.0:1789579000.438432:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:1.0:1789579000.438437:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261370624:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438462:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261370624:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438467:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:1.0:1789579000.438477:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:1.0:1789579000.438483:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261370496:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579000.438504:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261370496:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579000.438510:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00080000:1.0:1789579000.438535:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579000.438539:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579000.438542:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579000.438544:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789579000.439136:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261370112 00000100:00100000:3.0:1789579000.439141:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261370112 00000100:00100000:3.0:1789579000.443495:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 381 00000100:00100000:3.0:1789579000.443516:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261370112:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579000.443695:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261370112:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 184us (5914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579000.443703:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 381 00000040:00080000:1.0:1789579000.615301:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579000.615315:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579000.615403:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789579000.615417:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789579000.932179:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579000.995723:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579001.036838:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579001.036940:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371008 00000100:00100000:3.0:1789579001.036955:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371008 00000100:00100000:3.0:1789579001.037036:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:3.0:1789579001.037049:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+13:11063:x1876509261371008:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789579001.037193:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+13:11063:x1876509261371008:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579001.037202:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 147 00000100:00100000:1.0:1789579001.047484:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579001.047683:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371136 00000100:00100000:3.0:1789579001.047697:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371136 00000100:00100000:3.0:1789579001.047784:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:3.0:1789579001.047796:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:11063:x1876509261371136:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789579001.048160:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:11063:x1876509261371136:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 364us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579001.048170:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:0.0:1789579001.054871:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579001.054966:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371392 00000100:00100000:3.0:1789579001.054979:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371392 00000100:00100000:3.0:1789579001.055055:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:3.0:1789579001.055085:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+13:11063:x1876509261371392:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789579001.055933:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+14:11063:x1876509261371392:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 845us (1072us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789579001.055944:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:2.0:1789579001.187801:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277161344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579001.187896:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579001.188096:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579001.188124:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579001.188179:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579001.188183:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579001.188229:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579001.188471:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161344 00000100:00100000:3.0:1789579001.188481:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161344 00000100:00100000:3.0:1789579001.188540:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161600 00000100:00100000:3.0:1789579001.188544:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161600 00000100:00100000:3.0:1789579001.188564:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161472 00000100:00100000:3.0:1789579001.188566:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161472 00000100:00100000:3.0:1789579001.188584:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789579001.188594:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277161344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579001.188905:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00002000:00000024:3.0:1789579001.189030:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789579001.189094:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277161344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 502us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579001.189103:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789579001.189125:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789579001.189131:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277161472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789579001.189142:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789579001.189174:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277161472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579001.189180:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789579001.189213:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579001.189218:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579001.189329:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277161600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579001.189371:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789579001.189406:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277161600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 494us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579001.189413:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789579001.189556:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277161728:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.189762:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277161344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579001.189795:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277161856:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.189823:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579001.189848:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277162368:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.189869:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579001.189888:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277162880:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.189908:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.191026:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277162112:0@lo:400:kworker.0 00000100:00100000:3.0:1789579001.191197:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161856 00000100:00100000:3.0:1789579001.191207:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161856 00000100:00100000:3.0:1789579001.191284:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162368 00000100:00100000:3.0:1789579001.191305:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162368 00000100:00100000:3.0:1789579001.191337:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162880 00000100:00100000:3.0:1789579001.191340:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162880 00000100:00100000:3.0:1789579001.191380:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789579001.191390:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277161856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.191461:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.193895:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.193983:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277162624:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194036:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.194070:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277163136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579001.194097:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.194188:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579001.194218:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789579001.194225:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939402aa4e00, transno 4294967310 00000004:00080000:1.0:1789579001.194239:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789579001.194278:0:3618:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93930486f480 x1876509277161216/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789579014 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579001.194294:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277161600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579001.194328:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789579001.194336:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277161984:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194387:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.194409:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277162496:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194431:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.194442:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277163008:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579001.194515:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162624 00000100:00100000:1.0:1789579001.194524:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162624 00000100:00100000:1.0:1789579001.194582:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163008 00000100:00100000:1.0:1789579001.194585:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163008 00000100:00100000:1.0:1789579001.194624:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789579001.194634:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277162624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194694:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277162624:12345-0@lo:400:kworker.0 Request processed in 61us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.194702:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789579001.194720:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789579001.194726:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277163008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.194767:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277163008:12345-0@lo:400:kworker.0 Request processed in 41us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.194783:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789579001.194947:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162112 00000100:00100000:1.0:1789579001.194952:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162112 00000100:00100000:1.0:1789579001.194975:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162496 00000100:00100000:1.0:1789579001.194978:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162496 00000100:00100000:1.0:1789579001.194995:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789579001.195003:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277162368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195041:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277162368:12345-0@lo:400:kworker.0 Request processed in 39us (5171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195047:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789579001.195060:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789579001.195066:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277162880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195096:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277162880:12345-0@lo:400:kworker.0 Request processed in 31us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195101:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789579001.195112:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789579001.195118:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277162112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195144:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277162112:12345-0@lo:400:kworker.0 Request processed in 26us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195150:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789579001.195161:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789579001.195167:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277162496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195194:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277162496:12345-0@lo:400:kworker.0 Request processed in 28us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195200:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789579001.195230:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163136 00000100:00100000:1.0:1789579001.195234:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163136 00000100:00100000:1.0:1789579001.195263:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789579001.195269:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277163136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579001.195285:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789579001.195319:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277163136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195325:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1789579001.195387:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304887b80 x1876509277162496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579001.195400:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277162496:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195412:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277163008:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195424:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277162112:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195434:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277162624:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195447:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930411ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277163136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579001.195506:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161984 00000100:00100000:1.0:1789579001.195511:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161984 00000100:00100000:1.0:1789579001.195542:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789579001.195548:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277161984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195589:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277161984:12345-0@lo:400:kworker.0 Request processed in 41us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195594:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789579001.195617:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277161984:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195665:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277161728 00000100:00100000:1.0:1789579001.195677:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277161728 00000100:00100000:1.0:1789579001.195707:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789579001.195714:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277161728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.195761:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277161728:12345-0@lo:400:kworker.0 Request processed in 48us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.195767:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:1.0:1789579001.195818:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579001.195824:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579001.195827:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579001.201142:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277161856:12345-0@lo:400:kworker.0 Request processed in 9736us (11300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579001.201163:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789579001.201824:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277161728:0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.201843:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277162240:0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.201900:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579001.204030:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277162752:0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.204115:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789579001.204590:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304886680 x1876509277162880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579001.204621:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277162880:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.204674:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277161856:0@lo:400:kworker.0 00000100:00100000:2.0:1789579001.204689:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277162368:0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.204891:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162240 00000100:00100000:0.0:1789579001.204901:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162240 00000100:00100000:0.0:1789579001.204978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789579001.204989:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277162240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579001.205072:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277162240:12345-0@lo:400:kworker.0 Request processed in 84us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579001.205079:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789579001.205482:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277162240:0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.208133:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277162752 00000100:00100000:1.0:1789579001.208157:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277162752 00000100:00100000:1.0:1789579001.208863:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789579001.208878:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277162752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579001.209026:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277162752:12345-0@lo:400:kworker.0 Request processed in 152us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579001.209034:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789579001.209236:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277162752:0@lo:400:kworker.0 00000100:00080000:3.0:1789579001.209849:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789579002.019667:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579002.215535:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277163264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579002.215685:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579002.216214:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163264 00000100:00100000:0.0:1789579002.216227:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163264 00000100:00100000:0.0:1789579002.216321:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789579002.216333:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277163264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579002.216406:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789579002.216472:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277163264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579002.216480:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789579002.217116:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277163264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579002.217144:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579002.217156:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277163392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579002.217198:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579002.217336:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163392 00000100:00100000:0.0:1789579002.217344:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163392 00000100:00100000:0.0:1789579002.218410:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789579002.218431:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277163392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579002.218478:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789579002.218558:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277163392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579002.218565:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789579002.226277:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277163392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579003.044330:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789579003.186084:0:14484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:16:40 (1789579000) 00010000:00010000:2.0:1789579004.067664:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789579004.775163:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789579004.775198:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789579004.775372:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789579004.775387:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1789579004.775460:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:3.0:1789579005.093240:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579005.577306:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577394:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577438:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577471:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577494:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577516:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577547:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.577578:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371776 00000100:00100000:1.0:1789579005.577591:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371776 00000100:00100000:1.0:1789579005.577660:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372288 00000100:00100000:1.0:1789579005.577664:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372288 00000100:00100000:1.0:1789579005.577679:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371648 00000100:00100000:1.0:1789579005.577681:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371648 00000100:00100000:1.0:1789579005.577710:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372160 00000100:00100000:1.0:1789579005.577713:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372160 00000100:00100000:1.0:1789579005.577731:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 296 00000100:00100000:1.0:1789579005.577743:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261371776:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.577837:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261371776:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 95us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.577845:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 296 00000100:00100000:1.0:1789579005.577864:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 297 00000100:00100000:1.0:1789579005.577870:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261372288:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.577895:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261372288:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.577901:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 297 00000100:00100000:1.0:1789579005.577913:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 298 00000100:00100000:1.0:1789579005.577919:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+13:2395:x1876509261371648:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.577971:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+13:2395:x1876509261371648:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 51us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.577978:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 298 00000100:00100000:1.0:1789579005.577991:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:1.0:1789579005.577997:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261372160:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.578021:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261372160:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.578026:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 299 00000100:00100000:1.0:1789579005.578047:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372032 00000100:00100000:1.0:1789579005.578051:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372032 00000100:00100000:1.0:1789579005.578077:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371904 00000100:00100000:1.0:1789579005.578080:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371904 00000100:00100000:1.0:1789579005.578102:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:1.0:1789579005.578108:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261372032:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.578131:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930411dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261372032:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.578138:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:1.0:1789579005.578150:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:1.0:1789579005.578155:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261371904:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579005.578178:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261371904:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.578184:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:3.0:1789579005.579063:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261371520 00000100:00100000:3.0:1789579005.579073:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261371520 00000100:00100000:3.0:1789579005.579124:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 383 00000100:00100000:3.0:1789579005.579133:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261371520:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579005.579203:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261371520:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 71us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579005.579211:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 383 00000100:00080000:3.0:1789579005.580459:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579005.580476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579005.580489:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579005.580492:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579005.640691:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579005.652122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372544 00000100:00100000:2.0:1789579005.652148:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372544 00000100:00100000:2.0:1789579005.654028:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:2.0:1789579005.654045:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+13:12128:x1876509261372544:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579005.656659:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579005.656689:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f216e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0bf expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658014:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658034:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658046:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658156:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658165:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658172:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658530:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f216f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658540:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f216f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658548:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f216f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579005.658558:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789579005.658647:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658654:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658671:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658677:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579005.658680:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658688:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658709:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939302356c00) 00010000:00010000:3.0:1789579005.658713:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579005.658717:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658722:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f216eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658734:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658740:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658745:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.658750:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579005.658753:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.660883:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.660898:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939405f07900) 00010000:00010000:3.0:1789579005.660901:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579005.660906:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579005.660914:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f216f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579005.666014:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f216e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0bf expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579005.666039:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f216f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0bf expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579005.666047:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:0.0:1789579005.666050:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579005.666054:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:0.0:1789579005.666645:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+15:12128:x1876509261372544:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 12604us (25960us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789579005.666667:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:0.0:1789579005.673732:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579005.673874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579005.674008:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372800 00000100:00100000:1.0:1789579005.674029:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372800 00000100:00100000:1.0:1789579005.674083:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:1.0:1789579005.674091:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+15:2392:x1876509261372800:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579005.674105:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579005.674133:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f216f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0bf expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579005.674155:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789579005.674160:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579005.674217:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+14:2392:x1876509261372800:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579005.674238:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789579005.675483:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372672 00000100:00100000:2.0:1789579005.675492:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372672 00000100:00100000:0.0:1789579005.675667:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:0.0:1789579005.675677:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+14:12128:x1876509261372672:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789579005.675848:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+14:12128:x1876509261372672:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 171us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579005.675855:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:0.0:1789579005.678888:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579005.678962:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261372928 00000100:00100000:3.0:1789579005.678970:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261372928 00000100:00100000:3.0:1789579005.679021:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:3.0:1789579005.679030:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:12128:x1876509261372928:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789579005.679170:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:12128:x1876509261372928:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 141us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579005.679177:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 151 00000040:00080000:1.0:1789579005.731522:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579005.731529:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579005.732165:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789579005.732177:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789579006.052744:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789579006.123463:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579006.307533:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277163520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579006.307600:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.307659:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579006.307666:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277163648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579006.307686:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.307729:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163520 00000100:00100000:1.0:1789579006.307735:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163520 00000100:00100000:1.0:1789579006.307781:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163648 00000100:00100000:1.0:1789579006.307784:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163648 00000100:00100000:1.0:1789579006.307801:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789579006.307810:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277163520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579006.307852:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789579006.307895:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277163520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.307902:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789579006.307918:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789579006.307924:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277163648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789579006.307937:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789579006.307962:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277163648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.307968:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789579006.307985:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579006.307989:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579006.308019:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277163648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579006.308029:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277163520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579006.311169:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277163904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579006.311239:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.311287:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579006.311293:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789579006.311317:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.311867:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163904 00000100:00100000:1.0:1789579006.311875:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163904 00000100:00100000:1.0:1789579006.311920:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277163776 00000100:00100000:1.0:1789579006.311923:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277163776 00000100:00100000:1.0:1789579006.311940:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789579006.311948:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277163904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789579006.311966:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789579006.312019:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277163904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.312026:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789579006.312043:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789579006.312049:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277163776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579006.312071:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789579006.312097:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277163776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.312104:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789579006.312283:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789579006.312289:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93930486f480, transno 4294967313 00000100:00100000:1.0:1789579006.312306:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277163776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579006.312320:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277163904:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789579006.314479:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579006.314487:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579006.323601:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277164288:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.323664:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.323716:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277164800:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.323739:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.323776:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789579006.323783:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277164416:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.323805:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.323823:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277164928:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.323842:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579006.323875:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164288 00000100:00100000:1.0:1789579006.323883:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164288 00000100:00100000:1.0:1789579006.323920:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789579006.323929:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277164288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.323975:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277164288:12345-0@lo:400:kworker.0 Request processed in 48us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.323983:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789579006.324012:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164800 00000100:00100000:1.0:1789579006.324016:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164800 00000100:00100000:1.0:1789579006.324047:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164416 00000100:00100000:1.0:1789579006.324050:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164416 00000100:00100000:1.0:1789579006.324064:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789579006.324070:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277164800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.324100:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277164800:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.324106:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789579006.324115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164928 00000100:00100000:1.0:1789579006.324118:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164928 00000100:00100000:1.0:1789579006.324132:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789579006.324137:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277164416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.324161:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277164416:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.324166:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789579006.324176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789579006.324181:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277164928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.324204:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277164928:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.324209:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:1.0:1789579006.324236:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579006.324239:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579006.324275:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277164416:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.324285:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277164928:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.324292:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277164288:0@lo:400:kworker.0 00010000:00080000:1.0:1789579006.324311:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304810700 x1876509277164800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579006.324321:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277164800:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324549:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277164160:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324577:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.324601:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277164672:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324620:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.324635:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789579006.324641:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277164032:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.324681:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277164544:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324710:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.324727:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277165056:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.324746:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579006.325435:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164544 00000100:00100000:2.0:1789579006.325442:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164544 00000100:00100000:2.0:1789579006.325479:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789579006.325486:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277164544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.325532:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277164544:12345-0@lo:400:kworker.0 Request processed in 47us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579006.325538:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789579006.325567:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277164544:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.326601:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164032 00000100:00100000:1.0:1789579006.326607:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164032 00000100:00100000:1.0:1789579006.326636:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789579006.326643:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277164032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.326685:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3618:x1876509277164032:12345-0@lo:400:kworker.0 Request processed in 42us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.326702:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789579006.326729:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164160 00000100:00100000:1.0:1789579006.326733:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164160 00000100:00100000:1.0:1789579006.326753:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277164672 00000100:00100000:1.0:1789579006.326756:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277164672 00000100:00100000:2.0:1789579006.327378:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277164032:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.328421:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277165056 00000100:00100000:2.0:1789579006.328428:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277165056 00000100:00100000:2.0:1789579006.328475:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789579006.328483:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277164160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.328542:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277164160:12345-0@lo:400:kworker.0 Request processed in 60us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579006.328548:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789579006.328562:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789579006.328568:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277165056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.328596:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277165056:12345-0@lo:400:kworker.0 Request processed in 28us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579006.328601:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:2.0:1789579006.328631:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304812d80 x1876509277165056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579006.328642:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277165056:0@lo:400:kworker.0 00000100:00100000:2.0:1789579006.328653:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277164160:0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.328931:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789579006.328939:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277164672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579006.328975:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277164672:12345-0@lo:400:kworker.0 Request processed in 38us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579006.328981:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:1.0:1789579006.329002:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579006.329006:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579006.329383:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277164672:0@lo:400:kworker.0 00010000:00010000:3.0:1789579007.141237:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579007.332005:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277165184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579007.332088:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579007.332161:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277165184 00000100:00100000:3.0:1789579007.332168:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277165184 00000100:00100000:3.0:1789579007.332208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789579007.332217:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277165184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579007.332261:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789579007.332304:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277165184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579007.332323:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789579007.332396:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277165184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579007.332481:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579007.332491:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277165312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579007.332521:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579007.337951:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277165312 00000100:00100000:1.0:1789579007.337966:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277165312 00000100:00100000:1.0:1789579007.338039:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789579007.338049:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277165312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579007.338083:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789579007.338158:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277165312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579007.338179:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789579007.338467:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277165312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579007.870833:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579007.870929:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373056 00000100:00100000:0.0:1789579007.870939:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373056 00000100:00100000:0.0:1789579007.871001:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00100000:0.0:1789579007.871013:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+14:12171:x1876509261373056:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579007.871040:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579007.871064:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0c6 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871396:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871419:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871432:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871446:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871452:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871459:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871499:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871505:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871512:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871518:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579007.871522:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871529:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871540:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:0.0:1789579007.871547:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579007.871551:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871557:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2170e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871569:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871573:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871579:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871584:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579007.871587:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871592:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871597:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939412b0f600) 00010000:00010000:0.0:1789579007.871599:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579007.871601:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871607:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.871635:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21707 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0c6 expref: 15 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.872197:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:0.0:1789579007.872200:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579007.872205:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0c6 expref: 15 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579007.872275:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789579007.872337:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+14:12171:x1876509261373056:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1326us (1513us total) trans 0 rc 301/301 00000100:00100000:0.0:1789579007.872345:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00080000:1.0:1789579007.872451:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579007.880797:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579007.880874:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373312 00000100:00100000:1.0:1789579007.880885:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373312 00000100:00100000:1.0:1789579007.880941:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 153 00000100:00100000:1.0:1789579007.880952:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+14:12171:x1876509261373312:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:1.0:1789579007.881008:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579007.881032:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f21069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef1 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881052:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126a00) 00010000:00010000:1.0:1789579007.881062:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579007.881139:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881155:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881166:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881177:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881184:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881190:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881782:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881794:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881801:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579007.881815:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7096914 reply state 000000003adac80c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881826:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881833:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579007.881836:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789579007.881839:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789579007.881844:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789579007.881850:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881857:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881864:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881870:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579007.881874:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881891:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881899:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579007.881901:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579007.881905:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.881911:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2171c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579007.882417:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7096914 reply state 000000003adac80c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.882430:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579007.882749:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939410126300) 00010000:00010000:1.0:1789579007.882806:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789579007.882810:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789579007.882929:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+15:12171:x1876509261373312:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 1977us (2140us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789579007.882937:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 153 00000100:00100000:0.0:1789579007.969538:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579007.969629:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373440 00000100:00100000:2.0:1789579007.969640:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373440 00000100:00100000:2.0:1789579007.969709:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 154 00000100:00100000:2.0:1789579007.969721:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+15:12179:x1876509261373440:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:2.0:1789579007.969745:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579007.969766:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0cd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969838:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969851:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969861:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579007.969906:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789579007.969910:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579007.969929:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969950:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0cd expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969967:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0cd expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579007.969975:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:2.0:1789579007.969990:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579007.969993:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789579007.970052:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+16:12179:x1876509261373440:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 333us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579007.970059:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 154 00000100:00100000:0.0:1789579008.031416:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.031519:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373568 00000100:00100000:1.0:1789579008.031529:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373568 00000100:00100000:1.0:1789579008.031590:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:1.0:1789579008.031601:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+16:12185:x1876509261373568:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579008.031631:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.031655:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2173f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0d4 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031748:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031763:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031776:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031788:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031795:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031803:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031874:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031883:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031889:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579008.031925:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789579008.031928:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579008.031948:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.031972:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032198:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032207:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032212:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579008.032217:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032225:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032236:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:1.0:1789579008.032239:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579008.032245:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032251:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032268:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032286:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032292:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032303:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579008.032307:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032313:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032321:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939410126300) 00010000:00010000:1.0:1789579008.032324:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579008.032327:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.032333:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f2174d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.033158:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f2173f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0d4 expref: 18 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.033180:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0d4 expref: 17 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.033188:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579008.033190:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789579008.033193:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:1.0:1789579008.033298:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+17:12185:x1876509261373568:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1699us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.033306:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:1.0:1789579008.040567:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579008.040698:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373824 00000100:00100000:2.0:1789579008.040709:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373824 00000100:00100000:2.0:1789579008.040769:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00100000:2.0:1789579008.040778:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+17:12185:x1876509261373824:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789579008.040799:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579008.040818:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2175b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0db expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.040946:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.040961:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.040973:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041043:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041051:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041058:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789579008.041436:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789579008.041558:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041567:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041575:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041606:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041614:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041620:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041627:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579008.041631:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041639:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041650:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579008.041653:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579008.041657:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041674:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21762 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789579008.041700:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007de21052 reply state 00000000e066d4ac transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041711:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041717:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:2.0:1789579008.041719:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789579008.041722:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789579008.041748:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2175b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041762:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.041769:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:2.0:1789579008.041771:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579008.041773:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789579008.041844:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+20:12185:x1876509261373824:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1067us (1284us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789579008.041852:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 156 00000100:00100000:0.0:1789579008.048042:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.048267:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261373952 00000100:00100000:1.0:1789579008.048284:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261373952 00000100:00100000:1.0:1789579008.048402:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789579008.048414:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2393:x1876509261373952:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579008.048431:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.048450:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0e2 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789579008.048474:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579008.048493:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1789579008.048497:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579008.048507:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.048525:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 6 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.048538:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:1.0:1789579008.048592:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28fc5077-c53d-437a-bade-84c159d25114+6:2393:x1876509261373952:12345-192.168.203.37@tcp:101:bash.0 Request processed in 181us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.048599:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00080000:2.0:1789579008.048881:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579008.051608:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.051725:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261374080 00000100:00100000:1.0:1789579008.051734:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261374080 00000100:00100000:1.0:1789579008.051791:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:1.0:1789579008.051802:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:12185:x1876509261374080:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579008.051818:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.051849:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0e9 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.051880:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.051889:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579008.051893:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579008.051898:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.051930:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.051943:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579008.051958:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277165440:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579008.052112:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579008.056214:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.057190:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277165440:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579008.057229:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.057250:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6600, rc 0) 00000100:00100000:1.0:1789579008.057847:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:12185:x1876509261374080:12345-192.168.203.37@tcp:101:bash.0 Request processed in 6044us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.057874:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:2.0:1789579008.058085:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261374208 00000100:00100000:2.0:1789579008.058094:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261374208 00010000:00010000:2.0:1789579008.058127:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.058173:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:2.0:1789579008.058183:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261374208:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579008.058197:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579008.058235:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.058247:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.058268:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994480a9/0xd90373d592f2177e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e2 expref: 7 pid: 8403 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.058749:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579008.058754:0:13705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579008.058765:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.058777:0:13705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.058820:0:13705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.058837:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13705:1876509277165568:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789579008.058908:0:13705:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec840 going to sleep for 11 seconds 00000100:00100000:2.0:1789579008.064967:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13705:1876509277165568:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789579008.064992:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579008.065053:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261374208:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 6870us (8847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579008.065064:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:0.0:1789579008.076450:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.076609:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261374464 00000100:00100000:3.0:1789579008.076619:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261374464 00000100:00100000:3.0:1789579008.076670:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:3.0:1789579008.076691:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+20:12185:x1876509261374464:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:3.0:1789579008.076976:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12185:x1876509261374464:12345-192.168.203.37@tcp:35:bash.0 Request processed in 297us (536us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789579008.076983:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:0.0:1789579008.150342:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579008.150414:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261374720 00000100:00100000:2.0:1789579008.150424:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261374720 00000100:00100000:2.0:1789579008.150488:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 157 00000100:00100000:2.0:1789579008.150498:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+21:12195:x1876509261374720:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579008.150521:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579008.150539:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2178c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0f0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579008.150630:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789579008.150741:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2178c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0f0 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.150756:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:2.0:1789579008.150759:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579008.150765:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f2178c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0f0 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.150780:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789579008.150841:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+22:12195:x1876509261374720:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 344us (507us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789579008.150847:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 157 00000100:00100000:0.0:1789579008.154491:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.154606:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261374976 00000100:00100000:3.0:1789579008.154745:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261374976 00000100:00100000:3.0:1789579008.154848:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:3.0:1789579008.154859:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+22:12195:x1876509261374976:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579008.155071:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+23:12195:x1876509261374976:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 213us (591us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789579008.155079:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00010000:00010000:0.0:1789579008.163932:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579008.201298:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.201510:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261375104 00000100:00100000:1.0:1789579008.201519:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261375104 00000100:00100000:1.0:1789579008.201571:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:1.0:1789579008.201581:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+23:12201:x1876509261375104:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579008.201603:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.201622:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2179a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0f7 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201694:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201707:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201719:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579008.201757:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789579008.201760:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579008.201785:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201807:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f2179a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0f7 expref: 25 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201825:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0f7 expref: 24 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.201850:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579008.201854:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579008.201857:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:1.0:1789579008.201916:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+24:12201:x1876509261375104:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.201922:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 158 00000100:00100000:0.0:1789579008.204395:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.204485:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261375360 00000100:00100000:3.0:1789579008.204493:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261375360 00000100:00100000:3.0:1789579008.204556:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:3.0:1789579008.204570:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+24:12201:x1876509261375360:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579008.204588:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579008.204606:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f217a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec0fe expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.204710:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f217af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.204730:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f217af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.204738:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f217af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579008.204747:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789579008.204855:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f217a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0fe expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.204873:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f217af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0fe expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.204882:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:3.0:1789579008.204885:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579008.204888:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37a00, rc 0) 00000100:00100000:3.0:1789579008.204942:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+26:12201:x1876509261375360:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 377us (598us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789579008.204950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 159 00000100:00100000:0.0:1789579008.209286:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579008.209436:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.209506:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261375488 00000100:00100000:1.0:1789579008.209516:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261375488 00000100:00100000:1.0:1789579008.209581:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:1.0:1789579008.209591:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+26:2393:x1876509261375488:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579008.209606:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579008.209628:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f217af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0fe expref: 26 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.209646:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:1.0:1789579008.209651:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579008.209713:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+25:2393:x1876509261375488:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 123us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.209720:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:2.0:1789579008.209864:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261375744 00000100:00100000:2.0:1789579008.209869:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261375744 00000100:00100000:2.0:1789579008.209909:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:2.0:1789579008.209918:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+25:12201:x1876509261375744:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579008.209938:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579008.209953:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f217bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec105 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.210051:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.210066:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.210077:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579008.210089:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789579008.210190:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f217bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec105 expref: 28 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.210215:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec105 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.210224:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:2.0:1789579008.210226:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789579008.210229:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af400, rc 0) 00000100:00100000:2.0:1789579008.210254:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+27:12201:x1876509261375744:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 338us (818us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789579008.210271:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 160 00000100:00100000:0.0:1789579008.227713:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.227919:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261375872 00000100:00100000:1.0:1789579008.227995:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261375872 00000100:00100000:1.0:1789579008.228109:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:1.0:1789579008.228120:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261375872:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:1.0:1789579008.228169:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.228464:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.228473:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579008.228477:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789579008.228482:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.228637:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.228652:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 6 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579008.228667:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277165696:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579008.228781:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579008.234893:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277165696:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579008.235614:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579008.236088:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579008.238377:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376000 00000100:00100000:0.0:1789579008.238391:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376000 00002000:00100000:0.0:1789579008.238459:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9393043a9880 x1876509261376000/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:254/0 lens 504/0 e 0 to 0 dl 1789579019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579008.238470:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9393043a9880 with x1876509261376000 ext(0->12) 00010000:00010000:0.0:1789579008.238479:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 7 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.238496:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 7 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579008.238504:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9393043a9880 00000100:00100000:0.0:1789579008.238816:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:0.0:1789579008.238829:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261376000:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:0.0:1789579008.242249:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261376000:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 3414us (6154us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789579008.242270:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00002000:00100000:0.0:1789579008.242283:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9393043a9880 x1876509261376000/t4294967306(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:254/0 lens 504/448 e 0 to 0 dl 1789579019 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579008.242293:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9393043a9880 with x1876509261376000 ext(0->12) 00010000:00010000:0.0:1789579008.242305:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.242325:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579008.242333:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9393043a9880 00000100:00100000:0.0:1789579008.246073:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.246129:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376128 00000100:00100000:3.0:1789579008.246137:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376128 00010000:00010000:3.0:1789579008.246175:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579008.246217:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:3.0:1789579008.246226:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261376128:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579008.246257:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789579008.246274:0:6475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789579008.246277:0:6475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789579007 00002000:00010000:3.0:1789579008.246279:0:6475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789579007 00002000:00010000:3.0:1789579008.246281:0:6475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789579007 00002000:00010000:3.0:1789579008.246283:0:6475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789579008.246290:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.246303:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.246325:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae481367/0xd90373d592f21785 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0e9 expref: 9 pid: 8405 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.246343:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789579008.246398:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789579008.246406:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579008.246416:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.246521:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579008.246558:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246566:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.246587:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261376128:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 360us (521us total) trans 0 rc 0/0 00010000:00010000:1.0:1789579008.246589:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.246596:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00010000:00010000:1.0:1789579008.246604:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246612:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246628:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579008.246632:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246640:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246652:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.246659:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6521e38/0xd90373d592f217d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579008.246729:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261375872:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 18610us (19024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.246737:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789579008.248454:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.248585:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376384 00000100:00100000:1.0:1789579008.248593:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376384 00000100:00100000:1.0:1789579008.248634:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:1.0:1789579008.248653:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b603c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+27:12201:x1876509261376384:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:1.0:1789579008.248722:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec105 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579008.248934:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789579008.249756:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789579008.251394:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789579008.251452:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.251473:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 31 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.251482:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.251519:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 31 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.251535:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 31 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579008.251548:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876509277165824:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579008.251633:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579008.254547:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579008.255070:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376512 00000100:00100000:2.0:1789579008.255079:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376512 00010000:00010000:2.0:1789579008.255116:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 32 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.255160:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 82 00000100:00100000:2.0:1789579008.255170:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+32:2394:x1876509261376512:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579008.255185:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579008.255191:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 32 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.255213:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 32 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.255241:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:2.0:1789579008.255247:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.255256:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.255263:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.255295:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579008.255343:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+32:2394:x1876509261376512:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 174us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579008.255365:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 82 00010000:00010000:1.0:1789579008.256195:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21770 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0db expref: 31 pid: 6491 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579008.256317:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876509277165824:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579008.256336:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.256344:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.256367:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579008.256461:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789579008.256566:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789579008.257664:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277165952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789579008.257738:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579008.257773:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579008.257831:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277165952 00000100:00100000:3.0:1789579008.257838:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277165952 00000100:00100000:3.0:1789579008.257905:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789579008.257914:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277165952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789579008.258033:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277165952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579008.258041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789579008.258433:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277165952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789579008.258572:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789579008.258648:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277166080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789579008.258692:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579008.258719:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789579008.258780:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277166080 00000100:00100000:3.0:1789579008.258785:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277166080 00000100:00100000:3.0:1789579008.258820:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789579008.258828:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277166080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789579008.259041:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1876509277166080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 213us (348us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789579008.259048:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1789579008.259587:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579008.260098:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277166080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789579008.260160:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789579008.260463:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260474:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260482:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260488:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579008.260493:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260501:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260517:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:0.0:1789579008.260520:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789579008.260526:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579008.260547:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789579008.260848:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789579008.260907:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1789579008.261039:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363393687649ns, next at 364393565629ns, rc = 0 00000001:00080000:0.0:1789579008.261049:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789579008.261079:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9394091b5a00) 00010000:00010000:0.0:1789579008.261083:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789579008.261090:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f217c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec105 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579008.261335:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b603c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+34:12201:x1876509261376384:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 12692us (12881us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789579008.261345:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000020:00080000:0.0:1789579008.261377:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789579008.266760:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.267006:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376640 00000100:00100000:1.0:1789579008.267017:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376640 00000100:00100000:1.0:1789579008.267077:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:1.0:1789579008.267088:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+34:12201:x1876509261376640:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579008.267116:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.267137:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec10c expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.267192:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec10c expref: 35 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.267208:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec10c expref: 35 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.267242:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579008.267245:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789579008.267261:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519400, rc 0) 00000100:00100000:1.0:1789579008.267328:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+35:12201:x1876509261376640:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 241us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579008.267334:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 161 00000100:00100000:1.0:1789579008.276017:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.276442:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261376896 00000100:00100000:3.0:1789579008.276451:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261376896 00000100:00100000:3.0:1789579008.276551:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789579008.276563:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+35:12201:x1876509261376896:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579008.276866:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+36:12201:x1876509261376896:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 304us (857us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789579008.276874:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:2.0:1789579008.406719:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579008.406802:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261377152 00000100:00100000:3.0:1789579008.406811:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261377152 00000100:00100000:2.0:1789579008.407823:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 162 00000100:00100000:2.0:1789579008.408154:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+36:12211:x1876509261377152:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579008.408177:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579008.408195:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f217e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec113 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579008.408617:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789579008.408724:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f217e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec113 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.408739:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:2.0:1789579008.408742:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579008.408748:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f217e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec113 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.408762:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579008.409550:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+37:12211:x1876509261377152:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1396us (2834us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789579008.409558:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 162 00000100:00100000:1.0:1789579008.415588:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579008.415687:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261377280 00000100:00100000:2.0:1789579008.415709:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261377280 00000100:00100000:2.0:1789579008.415797:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:2.0:1789579008.415808:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+37:12211:x1876509261377280:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:2.0:1789579008.415884:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.415900:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.415910:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416024:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416034:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416040:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416109:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416118:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416125:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789579008.416173:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416195:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416202:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416394:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416400:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579008.416404:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416411:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416422:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579008.416425:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579008.416429:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416434:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f217f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416447:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416452:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416457:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416468:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579008.416471:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416477:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416485:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:2.0:1789579008.416487:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579008.416490:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416634:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f217fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416645:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416651:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416657:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416662:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579008.416665:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416671:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416700:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579008.416702:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579008.416705:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.416711:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21803 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.416842:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+37:12211:x1876509261377280:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1035us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579008.416850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 163 00000100:00100000:1.0:1789579008.421988:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579008.422176:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261377536 00000100:00100000:0.0:1789579008.422185:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261377536 00000100:00100000:0.0:1789579008.422242:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789579008.422252:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+37:12211:x1876509261377536:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789579008.422765:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+38:12211:x1876509261377536:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 512us (785us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789579008.422773:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789579008.512050:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579008.512605:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261377792 00000100:00100000:1.0:1789579008.512616:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261377792 00000100:00100000:1.0:1789579008.512737:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:1.0:1789579008.512748:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+38:12214:x1876509261377792:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579008.512775:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579008.512797:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2180a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec11a expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.512909:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513053:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513067:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513080:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513095:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513102:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513659:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513669:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513689:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579008.513698:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789579008.513770:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513777:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513783:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513789:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579008.513793:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513799:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.513821:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579008.513913:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579008.514034:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514041:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21811 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514058:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514063:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514068:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514073:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579008.514075:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514080:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514088:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:1.0:1789579008.514090:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579008.514092:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514097:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367e00/0xd90373d592f21818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514776:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f2180a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 41 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514797:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 40 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579008.514804:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579008.514806:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579008.514809:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367200, rc 0) 00000100:00100000:1.0:1789579008.514887:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+40:12214:x1876509261377792:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2140us (2846us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789579008.514894:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 164 00000100:00100000:1.0:1789579008.523688:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579008.523796:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261377920 00000100:00100000:2.0:1789579008.523807:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261377920 00000100:00100000:2.0:1789579008.524667:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 165 00000100:00100000:2.0:1789579008.524688:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+40:12214:x1876509261377920:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:2.0:1789579008.524751:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524766:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524777:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524810:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524816:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524838:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524844:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579008.524848:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524855:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524867:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579008.524869:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579008.524873:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579008.524879:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f2182d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579008.524962:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+40:12214:x1876509261377920:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 286us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579008.524969:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 165 00000100:00100000:1.0:1789579008.530104:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579008.530720:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261378176 00000100:00100000:0.0:1789579008.530745:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261378176 00000100:00100000:0.0:1789579008.530835:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789579008.530846:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+40:12214:x1876509261378176:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789579008.531247:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+41:12214:x1876509261378176:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 401us (1151us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789579008.531255:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789579009.158732:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579009.159697:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261378432 00000100:00100000:2.0:1789579009.159709:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261378432 00000100:00100000:2.0:1789579009.159842:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:2.0:1789579009.159850:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+41:12245:x1876509261378432:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789579009.159870:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579009.159886:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21834 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec121 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.160004:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2183b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.160019:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2183b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.160031:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2183b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579009.160043:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789579009.160142:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21834 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec121 expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.160682:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2183b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec121 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.160695:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579009.160698:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579009.160701:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789579009.160772:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+43:12245:x1876509261378432:12345-192.168.203.37@tcp:101:cat.0 Request processed in 922us (2048us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789579009.160779:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:3.0:1789579009.167255:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579009.169269:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579009.169376:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261378816 00000100:00100000:3.0:1789579009.169386:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261378816 00000100:00100000:3.0:1789579009.169441:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:3.0:1789579009.169452:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+43:12245:x1876509261378816:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:3.0:1789579009.169702:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+44:12245:x1876509261378816:12345-192.168.203.37@tcp:35:cat.0 Request processed in 251us (440us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789579009.169726:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00080000:1.0:1789579009.171945:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579009.174635:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261378560 00000100:00100000:0.0:1789579009.174656:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261378560 00000100:00100000:0.0:1789579009.174752:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:0.0:1789579009.174763:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+44:2395:x1876509261378560:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579009.174781:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579009.174806:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f2183b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec121 expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.174836:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579009.174842:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579009.174900:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+43:2395:x1876509261378560:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 139us (7654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579009.174908:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00010000:00010000:2.0:1789579009.187770:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579009.269791:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579009.270464:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379072 00000100:00100000:1.0:1789579009.270474:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379072 00000100:00100000:1.0:1789579009.270544:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:1.0:1789579009.270553:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+43:12251:x1876509261379072:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:1.0:1789579009.270575:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579009.270578:0:9792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789579009.270599:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f217a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0f7 expref: 43 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270620:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579009.270625:0:9792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579009.270647:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21849 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec128 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270760:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270774:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 43 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270783:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270811:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 43 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.270824:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 43 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579009.270837:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166208:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579009.270930:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579009.275774:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166208:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579009.275803:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579009.276826:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579009.277444:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379200 00000100:00100000:2.0:1789579009.277454:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379200 00010000:00010000:2.0:1789579009.277489:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 44 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579009.277560:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 83 00000100:00100000:2.0:1789579009.277570:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+44:2395:x1876509261379200:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579009.277585:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579009.277593:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 44 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277606:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 44 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277625:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2181f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec11a expref: 44 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277642:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579009.277647:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277655:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277663:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.277704:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579009.277750:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+43:2395:x1876509261379200:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 182us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579009.277757:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 83 00010000:00010000:0.0:1789579009.278007:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.278016:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579009.278034:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789579009.278181:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21849 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 44 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.278197:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 43 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.278212:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579009.278215:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789579009.278217:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366200, rc 0) 00000100:00100000:0.0:1789579009.278250:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+43:12251:x1876509261379072:12345-192.168.203.37@tcp:101:dd.0 Request processed in 7698us (8467us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789579009.278257:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 167 00000100:00100000:1.0:1789579009.291388:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579009.291453:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379328 00000100:00100000:2.0:1789579009.291485:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379328 00000100:00100000:2.0:1789579009.291557:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:2.0:1789579009.291568:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+43:12251:x1876509261379328:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789579009.291589:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579009.291609:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2185e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec12f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291643:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291657:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291681:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291790:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2185e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 45 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291809:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 44 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.291818:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579009.291821:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579009.291838:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789579009.291906:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+44:12251:x1876509261379328:12345-192.168.203.37@tcp:101:dd.0 Request processed in 340us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579009.291913:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:2.0:1789579009.297551:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579009.297693:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379584 00000100:00100000:0.0:1789579009.297707:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379584 00000100:00100000:0.0:1789579009.297763:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 169 00000100:00100000:0.0:1789579009.297772:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+44:12251:x1876509261379584:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:0.0:1789579009.298066:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.298085:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.298097:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789579009.298146:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1789579009.298983:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b30f3167 reply state 000000007ef71fb7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.298999:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579009.299007:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579009.299010:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579009.299014:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789579009.300972:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+47:12251:x1876509261379584:12345-192.168.203.37@tcp:36:dd.0 Request processed in 3192us (3421us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789579009.300984:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 169 00000020:00080000:0.0:1789579009.300991:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789579009.715997:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579009.716157:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379712 00000100:00100000:1.0:1789579009.716170:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379712 00000100:00100000:1.0:1789579009.716243:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 170 00000100:00100000:1.0:1789579009.716253:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+47:12265:x1876509261379712:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:1.0:1789579009.716276:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579009.716294:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21873 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec136 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716403:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716417:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716427:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716436:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716442:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716448:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716503:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716512:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 48 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716520:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716548:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 48 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.716569:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 48 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579009.716581:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166336:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579009.716802:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579009.719436:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579009.719860:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261379968 00000100:00100000:3.0:1789579009.719869:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261379968 00000100:00100000:3.0:1789579009.719916:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:3.0:1789579009.719924:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+49:6163:x1876509261379968:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789579009.720789:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+50:6163:x1876509261379968:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 861us (1356us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789579009.720797:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789579009.721874:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166336:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579009.721902:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579009.724696:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579009.724803:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261380096 00000100:00100000:1.0:1789579009.724821:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261380096 00010000:00010000:1.0:1789579009.724864:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 50 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579009.724907:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:1.0:1789579009.724917:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+50:2394:x1876509261380096:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579009.724931:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579009.724938:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 50 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.724950:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 50 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.724977:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21850 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec128 expref: 50 pid: 9792 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.724996:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579009.725001:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.725022:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579009.725029:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725452:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725461:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579009.725521:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789579009.725526:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579009.725551:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725564:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725574:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725581:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725587:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725592:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579009.725596:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725603:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725619:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579009.725621:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579009.725626:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725632:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f2187a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725644:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725652:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725658:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725663:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579009.725677:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725684:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725692:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:2.0:1789579009.725694:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579009.725697:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725703:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21881 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725770:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21873 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec136 expref: 50 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725785:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec136 expref: 49 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579009.725792:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579009.725794:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579009.725797:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366000, rc 0) 00000100:00100000:2.0:1789579009.725865:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+49:12265:x1876509261379712:12345-192.168.203.37@tcp:101:stat.0 Request processed in 9612us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579009.725873:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 170 00010000:00010000:1.0:1789579009.725926:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579009.725948:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+48:2394:x1876509261380096:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1033us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579009.725955:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 84 00000100:00100000:0.0:1789579009.859952:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579009.860108:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261380352 00000100:00100000:3.0:1789579009.860118:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261380352 00000100:00100000:3.0:1789579009.860213:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 171 00000100:00100000:3.0:1789579009.860223:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+48:12271:x1876509261380352:12345-192.168.203.37@tcp:36:truncate.0 00010000:00010000:3.0:1789579009.860441:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579009.860467:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec136 expref: 48 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579009.860755:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579009.860842:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579009.861005:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579009.861187:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579009.861201:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579009.861263:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789579009.861285:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c55b295a reply state 000000005eac1fcb transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579009.861298:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579009.861304:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579009.861307:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579009.861310:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579009.861642:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+50:12271:x1876509261380352:12345-192.168.203.37@tcp:36:truncate.0 Request processed in 1419us (1697us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789579009.861649:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 171 00000020:00080000:3.0:1789579009.861655:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789579010.110614:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.110711:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261380480 00000100:00100000:3.0:1789579010.110721:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261380480 00000100:00100000:3.0:1789579010.110795:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 172 00000100:00100000:3.0:1789579010.110809:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+50:12285:x1876509261380480:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:3.0:1789579010.110833:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579010.111264:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21896 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec13d expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.111327:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.111340:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.115784:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116003:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116019:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116028:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116112:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116122:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116130:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579010.116176:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789579010.116182:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579010.116301:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116315:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116323:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116329:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116346:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116443:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579010.116447:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116514:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116588:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579010.116593:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579010.116598:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116604:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f2189d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116618:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116624:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116630:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116635:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579010.116637:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116653:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116673:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:3.0:1789579010.116676:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579010.116679:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116685:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116723:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21896 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 52 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116738:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 51 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.116746:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579010.116748:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579010.116751:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:3.0:1789579010.116901:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+51:12285:x1876509261380480:12345-192.168.203.37@tcp:101:stat.0 Request processed in 6096us (6293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579010.116916:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 172 00000040:00080000:2.0:1789579010.150185:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789579010.200892:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.201658:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261380736 00000100:00100000:2.0:1789579010.201729:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261380736 00000100:00100000:3.0:1789579010.202727:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 173 00000100:00100000:3.0:1789579010.202743:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+51:12295:x1876509261380736:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579010.202763:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579010.202784:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec144 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579010.202953:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789579010.203158:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec144 expref: 53 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.203173:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:3.0:1789579010.203176:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789579010.203939:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec144 expref: 53 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.203959:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789579010.204208:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+52:12295:x1876509261380736:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1469us (3323us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789579010.204216:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 173 00010000:00010000:3.0:1789579010.212429:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579010.217945:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.222440:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261380992 00000100:00100000:3.0:1789579010.222619:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261380992 00000100:00100000:3.0:1789579010.222702:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:3.0:1789579010.222712:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b603850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+52:12295:x1876509261380992:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579010.222932:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b603850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+53:12295:x1876509261380992:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 220us (4995us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789579010.222940:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:1.0:1789579010.401208:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.401344:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261381248 00000100:00100000:3.0:1789579010.401397:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261381248 00000100:00100000:3.0:1789579010.401463:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:3.0:1789579010.401473:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+53:12301:x1876509261381248:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579010.401510:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579010.401529:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec14b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.401622:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.401637:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 54 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.401647:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.401692:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 54 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.401706:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 54 pid: 13782 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579010.401719:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277166464:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579010.401810:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789579010.411582:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.411686:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261381376 00000100:00100000:2.0:1789579010.411695:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261381376 00010000:00010000:2.0:1789579010.411734:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 55 pid: 13782 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579010.411772:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 85 00000100:00100000:2.0:1789579010.411783:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+55:2395:x1876509261381376:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579010.412781:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579010.413033:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 55 pid: 13782 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.413070:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 55 pid: 13782 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.413095:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579010.413100:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.413110:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.413118:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.413139:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579010.414077:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec13d expref: 55 pid: 13782 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579010.414096:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6491:1876509277166464:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579010.414117:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.414140:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.414146:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579010.417428:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+54:2395:x1876509261381376:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 5636us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579010.417442:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 85 00000004:00200000:3.0:1789579010.418465:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789579010.418608:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.418630:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 54 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.418640:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579010.418643:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789579010.418646:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37a00, rc 0) 00000100:00100000:3.0:1789579010.418709:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+54:12301:x1876509261381248:12345-192.168.203.37@tcp:101:bash.0 Request processed in 17237us (17520us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789579010.418716:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 174 00000100:00100000:0.0:1789579010.434968:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.435074:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261381632 00000100:00100000:3.0:1789579010.435082:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261381632 00000100:00100000:3.0:1789579010.435126:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 175 00000100:00100000:3.0:1789579010.435132:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+54:12301:x1876509261381632:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:3.0:1789579010.435331:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.435383:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.435406:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579010.435514:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789579010.435538:0:13782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f633de2 reply state 00000000b7063c17 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.435551:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.435558:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579010.435561:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579010.435563:0:13782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579010.435625:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+57:12301:x1876509261381632:12345-192.168.203.37@tcp:36:bash.0 Request processed in 493us (666us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789579010.435630:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 175 00000020:00080000:3.0:1789579010.435634:0:13782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789579010.449522:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.449647:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261381760 00000100:00100000:3.0:1789579010.449657:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261381760 00000100:00100000:3.0:1789579010.449724:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 176 00000100:00100000:3.0:1789579010.449735:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+57:12301:x1876509261381760:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579010.449755:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579010.449775:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec152 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.449889:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.449904:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.449919:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.450144:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.450159:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 58 pid: 6491 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579010.450171:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166592:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579010.450262:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579010.454836:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277166592:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579010.454865:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579010.468114:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.468389:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261381888 00000100:00100000:2.0:1789579010.468400:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261381888 00010000:00010000:2.0:1789579010.468439:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 59 pid: 6491 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579010.468481:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 86 00000100:00100000:2.0:1789579010.468492:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+59:2395:x1876509261381888:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579010.468553:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579010.468560:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 59 pid: 6491 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468592:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 59 pid: 6491 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468613:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f218c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec14b expref: 59 pid: 6491 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468631:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579010.468636:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468646:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468655:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.468692:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579010.468738:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+58:2395:x1876509261381888:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 248us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579010.468745:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 86 00010000:00010000:3.0:1789579010.473874:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.473891:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579010.473954:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789579010.473958:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579010.473981:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.474021:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f218dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec152 expref: 58 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.474056:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec152 expref: 57 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.474065:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579010.474069:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579010.474072:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37600, rc 0) 00000100:00100000:3.0:1789579010.474131:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+57:12301:x1876509261381760:12345-192.168.203.37@tcp:101:bash.0 Request processed in 24398us (24617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579010.474140:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 176 00000100:00100000:3.0:1789579010.486726:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.486838:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261382144 00000100:00100000:2.0:1789579010.486848:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261382144 00000100:00100000:2.0:1789579010.486906:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789579010.486916:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+57:12301:x1876509261382144:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:2.0:1789579010.487144:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+58:12301:x1876509261382144:12345-192.168.203.37@tcp:35:bash.0 Request processed in 228us (426us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789579010.487153:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:3.0:1789579010.626604:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.626676:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261382400 00000100:00100000:2.0:1789579010.626686:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261382400 00000100:00100000:2.0:1789579010.626751:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:2.0:1789579010.626762:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+58:12311:x1876509261382400:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579010.626786:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579010.626885:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f218ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec159 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579010.626979:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789579010.627071:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f218ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec159 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.627085:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:2.0:1789579010.627087:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579010.627092:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f218ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec159 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.627105:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579010.629684:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+59:12311:x1876509261382400:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2914us (3078us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789579010.629696:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 177 00000100:00100000:1.0:1789579010.654808:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.655097:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261382528 00000100:00100000:0.0:1789579010.655107:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261382528 00000100:00100000:0.0:1789579010.655166:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:0.0:1789579010.655176:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+59:12311:x1876509261382528:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789579010.655245:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655261:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655273:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655300:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655308:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655315:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655425:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655435:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655442:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579010.655499:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655511:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655518:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655524:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655530:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579010.655534:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655549:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655560:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579010.655563:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579010.655568:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655574:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f218f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655586:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655592:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655598:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655603:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579010.655606:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655611:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655617:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:0.0:1789579010.655620:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579010.655622:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655638:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f218ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655647:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655652:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655667:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655672:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579010.655676:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655681:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655689:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579010.655691:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579010.655693:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.655699:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579010.655771:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+59:12311:x1876509261382528:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 596us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579010.655778:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 178 00000100:00100000:0.0:1789579010.688862:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.688903:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.688933:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.688964:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.688991:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.689009:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579010.689031:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579010.689104:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383296 00000100:00100000:1.0:1789579010.689112:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383296 00000100:00100000:1.0:1789579010.689169:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383168 00000100:00100000:1.0:1789579010.689171:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383168 00000100:00100000:1.0:1789579010.689191:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:1.0:1789579010.689209:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261383296:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579010.689273:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261383296:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579010.689281:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:1.0:1789579010.689294:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789579010.689309:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261383168:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579010.689342:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261383168:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579010.689374:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:1.0:1789579010.689392:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261382912 00000100:00100000:1.0:1789579010.689395:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261382912 00000100:00100000:1.0:1789579010.689416:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 385 00000100:00100000:1.0:1789579010.689422:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261382912:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579010.689443:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261382912:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 21us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579010.689448:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 385 00000100:00080000:0.0:1789579010.689785:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789579010.689789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579010.690033:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261382784 00000100:00100000:2.0:1789579010.690038:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261382784 00000100:00100000:2.0:1789579010.690073:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789579010.690080:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+59:12311:x1876509261382784:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579010.690264:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+60:12311:x1876509261382784:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 184us (1411us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789579010.690280:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789579010.690299:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383040 00000100:00100000:2.0:1789579010.690546:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383040 00000100:00100000:2.0:1789579010.690577:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383552 00000100:00100000:2.0:1789579010.690580:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383552 00000100:00100000:2.0:1789579010.690593:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383424 00000100:00100000:2.0:1789579010.690595:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383424 00000100:00100000:2.0:1789579010.690608:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 306 00000100:00100000:2.0:1789579010.690613:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261383040:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579010.690638:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261383040:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 25us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579010.690644:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 306 00000100:00100000:2.0:1789579010.690655:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 307 00000100:00080000:0.0:1789579010.690745:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789579010.690748:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579010.690771:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 308 00000100:00100000:0.0:1789579010.690781:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261383424:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579010.690807:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261383424:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579010.690813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 308 00000100:00100000:2.0:1789579010.690860:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261383552:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579010.690884:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261383552:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579010.690890:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 307 00000001:00080000:3.0:1789579010.697720:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:3.0:1789579010.697939:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789579010.697970:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939408fb1300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789579010.697977:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93941a91d200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939441a2fe40 00000020:00080000:3.0:1789579010.697980:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93941a91d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939304361800 00000020:00080000:0.0:1789579010.698066:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789579010.698171:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789579010.698974:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.698992:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699002:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699010:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.699016:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699026:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579010.699159:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277166720:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789579010.699892:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939410126300) 00010000:00010000:1.0:1789579010.699900:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.699928:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699938:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f21723 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699972:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699979:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699985:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.699990:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.699994:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700000:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700011:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579010.700014:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.700017:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700023:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f2172a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700043:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579010.700182:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579010.700721:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700751:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700757:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.700760:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700767:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700778:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5800) 00010000:00010000:1.0:1789579010.700781:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.700785:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700791:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21769 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700815:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700821:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700827:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700833:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.700835:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700851:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700860:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579010.700863:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.700866:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700873:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f2186c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700884:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700890:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700896:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700901:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.700904:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700909:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700916:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579010.700918:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.700921:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700935:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f2188f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700947:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700953:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700958:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700964:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579010.700966:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700973:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700980:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579010.700982:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579010.700984:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.700989:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f218d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579010.715239:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277166720 00000100:00100000:2.0:1789579010.715262:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277166720 00000100:00100000:2.0:1789579010.715469:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789579010.715483:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277166720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789579010.715538:0:10029:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1789579010.715588:0:10029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aaaceff, atime: 0x6aaaceff, ctime: 0x6aaaceff, blocks: 0x8 00010000:00010000:2.0:1789579010.715598:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.715642:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1789579010.715648:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579010.715656:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.715685:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.715696:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.715704:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.715728:0:10029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789579010.715995:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277166720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 514us (15813us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789579010.716004:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1789579010.716091:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579010.716099:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.716110:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579010.716116:0:10313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.716127:0:10313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.716156:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.716163:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae693b1/0xd90373d592f2190d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579010.716189:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579010.716191:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579010.716193:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789579010.716264:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93930489ed80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789579010.716272:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277166720:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789579010.717947:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579010.801501:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.803877:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383808 00000100:00100000:2.0:1789579010.803901:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383808 00000100:00100000:2.0:1789579010.804007:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:2.0:1789579010.804019:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+17:12314:x1876509261383808:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579010.804058:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579010.804084:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21914 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec160 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804209:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804224:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804238:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804254:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804261:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804268:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804462:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804472:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804479:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579010.804489:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789579010.804589:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804598:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804613:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804619:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579010.804625:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804634:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804648:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579010.804652:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579010.804668:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804676:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f2191b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804691:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804698:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804704:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804708:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579010.804711:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804726:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804734:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9394091b5b00) 00010000:00010000:2.0:1789579010.804736:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579010.804740:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804746:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21922 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804795:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21914 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec160 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804811:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec160 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579010.804819:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579010.804821:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579010.804824:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789579010.804918:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+19:12314:x1876509261383808:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 901us (3435us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789579010.804927:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 179 00000100:00100000:3.0:1789579010.808829:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579010.808945:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579010.809017:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261384064 00000100:00100000:1.0:1789579010.809031:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261384064 00000100:00100000:0.0:1789579010.809040:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261383936 00000100:00100000:0.0:1789579010.809044:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261383936 00000100:00100000:0.0:1789579010.809108:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:0.0:1789579010.809120:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:12314:x1876509261383936:12345-192.168.203.37@tcp:54:lfs.0 00000100:00100000:1.0:1789579010.809146:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789579010.809154:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+20:2392:x1876509261384064:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579010.809184:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579010.809212:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec160 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.809212:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.809234:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.809250:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579010.813999:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579010.814020:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579010.814136:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+19:2392:x1876509261384064:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4973us (5181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579010.814148:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00010000:00010000:0.0:1789579010.819394:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.819420:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.819429:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.819436:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579010.819443:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.819454:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.819478:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579010.819483:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789579010.819489:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579010.820116:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21937 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579010.821181:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+18:12314:x1876509261383936:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 12051us (12354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579010.821686:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 180 00000100:00100000:3.0:1789579010.830018:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579010.832681:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261384320 00000100:00100000:2.0:1789579010.832701:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261384320 00000100:00100000:2.0:1789579010.832797:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789579010.832810:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+18:12314:x1876509261384320:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579010.833144:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+19:12314:x1876509261384320:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 334us (3140us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789579010.833153:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000040:00080000:0.0:1789579010.851654:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789579010.851679:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579010.851827:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789579010.851838:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789579011.109151:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.109442:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261384576 00000100:00100000:2.0:1789579011.109453:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261384576 00000100:00100000:2.0:1789579011.109609:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00100000:2.0:1789579011.109620:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+19:12332:x1876509261384576:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:2.0:1789579011.109644:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579011.109673:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2193e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec167 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.109778:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21945 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.109792:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21945 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.109807:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21945 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579011.109820:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789579011.109924:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2193e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec167 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.109944:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21945 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec167 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.109953:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579011.109968:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789579011.109972:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789579011.110039:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12332:x1876509261384576:12345-192.168.203.37@tcp:101:cat.0 Request processed in 421us (898us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789579011.110045:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 181 00000100:00080000:0.0:1789579011.111043:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579011.138775:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579011.138866:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261384704 00000100:00100000:0.0:1789579011.138877:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261384704 00000100:00100000:0.0:1789579011.138937:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:0.0:1789579011.138947:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+21:12333:x1876509261384704:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579011.138973:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579011.138996:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec16e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139062:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139075:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139087:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579011.139131:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789579011.139135:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579011.139153:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139182:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec16e expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139212:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec16e expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.139221:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579011.139224:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789579011.139227:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579011.139963:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+22:12333:x1876509261384704:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1015us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579011.139969:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 182 00000100:00100000:1.0:1789579011.146802:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579011.147287:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385088 00000100:00100000:0.0:1789579011.147297:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385088 00000100:00100000:0.0:1789579011.147436:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:0.0:1789579011.147447:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+22:12333:x1876509261385088:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789579011.147853:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+23:12333:x1876509261385088:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 406us (1058us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789579011.147862:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:1.0:1789579011.151921:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.151984:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385216 00000100:00100000:2.0:1789579011.151994:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385216 00000100:00100000:2.0:1789579011.152059:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789579011.152069:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+23:12333:x1876509261385216:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:2.0:1789579011.152085:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789579011.152108:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f218e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec152 expref: 23 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.152130:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f21945 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec167 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.152143:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f217e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec10c expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.152168:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579011.152177:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579011.152237:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+20:12333:x1876509261385216:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 170us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.152245:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579011.163446:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579011.163686:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385344 00000100:00100000:0.0:1789579011.163697:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385344 00000100:00100000:0.0:1789579011.163763:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:0.0:1789579011.163774:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:12333:x1876509261385344:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:0.0:1789579011.163907:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.163924:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.163948:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579011.164052:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789579011.164142:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:12333:x1876509261385344:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 368us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579011.164150:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 183 00000100:00100000:1.0:1789579011.183598:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579011.183740:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385472 00000100:00100000:3.0:1789579011.183750:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385472 00000100:00100000:3.0:1789579011.183810:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 184 00000100:00100000:3.0:1789579011.183821:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+20:12335:x1876509261385472:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579011.183842:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579011.183860:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21968 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec175 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183921:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183949:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183961:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183978:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183985:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.183991:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184058:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184067:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184074:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579011.184239:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789579011.184244:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579011.184327:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184341:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184402:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184408:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184414:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184420:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579011.184424:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184431:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184443:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579011.184446:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579011.184450:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184456:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f2196f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184467:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184473:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184478:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184490:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579011.184855:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184865:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184874:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07300) 00010000:00010000:3.0:1789579011.184877:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579011.184880:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184886:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21976 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184919:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21968 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184931:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.184938:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579011.184940:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579011.184942:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789579011.185008:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+21:12335:x1876509261385472:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1189us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579011.185015:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 184 00010000:00010000:3.0:1789579011.235636:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579011.428028:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277166848:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428028:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277166976:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428375:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579011.428403:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277166976 00000100:00100000:2.0:1789579011.428413:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277166976 00000100:00100000:1.0:1789579011.428429:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579011.428447:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277167488:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428467:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579011.428474:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789579011.428487:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277166976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428488:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277168000:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428509:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.428525:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277167360:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428527:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277168512:0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.428564:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277166976:12345-0@lo:400:kworker.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.428573:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789579011.428578:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.428583:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579011.428592:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167488 00000100:00100000:2.0:1789579011.428597:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167488 00000100:00100000:1.0:1789579011.428614:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277167872:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428624:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277166976:0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.428637:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168000 00000100:00100000:0.0:1789579011.428641:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579011.428642:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168000 00000100:00100000:0.0:1789579011.428650:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277168896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579011.428683:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789579011.428688:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579011.428695:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277167488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.428717:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277168384:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428744:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277167488:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.428766:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277167104:0@lo:400:kworker.0 00000100:00100000:3.0:1789579011.428944:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277166848 00000100:00100000:3.0:1789579011.428950:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277166848 00000100:00100000:3.0:1789579011.428981:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789579011.428988:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277166848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.429178:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.429212:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168512 00000100:00100000:1.0:1789579011.429216:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168512 00000100:00100000:1.0:1789579011.429240:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167872 00000100:00100000:1.0:1789579011.429244:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167872 00000100:00100000:1.0:1789579011.429258:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168384 00000100:00100000:1.0:1789579011.429266:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168384 00000100:00100000:1.0:1789579011.429286:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789579011.429293:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.429332:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277168512:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.429338:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789579011.429371:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789579011.429378:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277167872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.429408:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277167872:12345-0@lo:400:kworker.0 Request processed in 32us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.429415:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789579011.429426:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789579011.429432:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277168384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.429457:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277168384:12345-0@lo:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.429463:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789579011.430184:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277167872:0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.430196:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277168384:0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.431512:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277167488:12345-0@lo:400:kworker.0 Request processed in 2814us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.431524:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789579011.431552:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789579011.431564:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277168000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.431614:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277168000:12345-0@lo:400:kworker.0 Request processed in 56us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.431621:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1789579011.431648:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789579011.431665:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579011.431669:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579011.432497:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167360 00000100:00100000:2.0:1789579011.432506:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167360 00000100:00100000:2.0:1789579011.432550:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789579011.432557:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.432620:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277167360:12345-0@lo:400:kworker.0 Request processed in 63us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.432626:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789579011.433282:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579011.433298:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277166848:12345-0@lo:400:kworker.0 Request processed in 4308us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579011.433307:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789579011.433329:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277167616:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.433397:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579011.433423:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277168256:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.433446:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579011.433461:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167104 00000100:00100000:2.0:1789579011.433466:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167104 00000100:00100000:2.0:1789579011.433495:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789579011.433502:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277167104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579011.433520:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167616 00000100:00100000:3.0:1789579011.433525:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167616 00000100:00100000:3.0:1789579011.433556:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168256 00000100:00100000:3.0:1789579011.433559:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168256 00000100:00100000:3.0:1789579011.433578:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789579011.433585:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277167616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.433768:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789579011.433778:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277168256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.438576:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277167104:12345-0@lo:400:kworker.0 Request processed in 5065us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.438590:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1789579011.438636:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789579011.438900:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277167616:12345-0@lo:400:kworker.0 Request processed in 5313us (5502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579011.438910:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789579011.438988:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277168256:12345-0@lo:400:kworker.0 Request processed in 5211us (5540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.438996:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789579011.439026:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277167232:0@lo:400:kworker.0 00010000:00080000:0.0:1789579011.439196:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304195880 x1876509277168256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579011.439210:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277168256:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.439218:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277168640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579011.439251:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579011.439305:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277167104:0@lo:400:kworker.0 00010000:00080000:0.0:1789579011.439314:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304195f80 x1876509277167616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579011.439322:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277167616:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.439345:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168896 00000100:00100000:0.0:1789579011.439379:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168896 00000100:00100000:0.0:1789579011.439420:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168640 00000100:00100000:0.0:1789579011.439422:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168640 00000100:00100000:0.0:1789579011.439434:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789579011.439449:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277168896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579011.439462:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789579011.439474:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277168640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579011.439493:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789579011.439534:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277168640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.439540:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789579011.439572:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277168640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579011.439642:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.439680:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277167744:0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.439703:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.439720:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579011.439758:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579011.439774:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277168768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579011.439792:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789579011.439893:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579011.439926:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167744 00000100:00100000:1.0:1789579011.439931:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167744 00002000:00000024:0.0:1789579011.439990:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789579011.440029:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277168896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 588us (11330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579011.440035:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789579011.440058:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168128 00000100:00100000:0.0:1789579011.440062:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168128 00000100:00100000:0.0:1789579011.440074:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277168768 00000100:00100000:0.0:1789579011.440083:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277168768 00000100:00100000:0.0:1789579011.440099:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789579011.440105:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277168128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579011.440115:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789579011.440147:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277168128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579011.440152:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789579011.440163:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789579011.440169:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277168768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579011.440178:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579011.440199:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277168768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579011.440204:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789579011.440234:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277168128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579011.440248:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277168768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579011.440274:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277168896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579011.440284:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277168000:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.440296:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277168512:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.440338:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277166848:0@lo:400:kworker.0 00000100:00100000:0.0:1789579011.440373:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277167360:0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.440514:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789579011.440522:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277167744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579011.440685:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277167744:12345-0@lo:400:kworker.0 Request processed in 164us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.440692:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789579011.440746:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277167744:0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.441076:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277167232 00000100:00100000:2.0:1789579011.441081:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277167232 00000100:00100000:2.0:1789579011.441164:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789579011.441172:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277167232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579011.441227:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277167232:12345-0@lo:400:kworker.0 Request processed in 56us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.441234:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789579011.441267:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277167232:0@lo:400:kworker.0 00000040:00080000:1.0:1789579011.879501:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579011.879508:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579011.879552:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789579011.879559:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789579011.879889:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277169024:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789579011.879979:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579011.892956:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277169024:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789579011.892958:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.892999:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385600 00000100:00100000:2.0:1789579011.893007:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385600 00000100:00100000:2.0:1789579011.893077:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:2.0:1789579011.893089:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261385600:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789579011.893124:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789579011.893231:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261385600:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 145us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.893239:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 185 00000100:00100000:0.0:1789579011.904688:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579011.905731:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385728 00000100:00100000:1.0:1789579011.905747:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385728 00000100:00100000:1.0:1789579011.905806:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:1.0:1789579011.905816:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261385728:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789579011.905901:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.905919:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.905934:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.905982:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.905990:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.905997:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906025:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906035:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906042:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579011.906086:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789579011.906090:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579011.906103:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906115:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906127:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906134:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906140:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579011.906144:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906151:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906164:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789579011.906167:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579011.906171:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906177:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21984 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906190:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906196:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906201:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906206:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579011.906214:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906221:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906229:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93940905ba00) 00010000:00010000:1.0:1789579011.906232:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579011.906235:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906241:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f2198b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906256:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906262:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906268:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906273:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579011.906276:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906282:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906289:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:1.0:1789579011.906292:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579011.906300:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.906306:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f21992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579011.906418:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261385728:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 602us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.906426:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 186 00000100:00100000:1.0:1789579011.909502:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.909677:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261385984 00000100:00100000:2.0:1789579011.909685:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261385984 00000100:00100000:2.0:1789579011.909736:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:2.0:1789579011.909745:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261385984:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579011.909765:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579011.909783:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21999 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec17c expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.909879:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.909892:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.909902:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579011.909912:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789579011.909979:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.909987:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.909993:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910011:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363aee00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579011.910015:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910022:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910033:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579011.910036:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579011.910041:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910047:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910084:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21999 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec17c expref: 23 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910093:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:2.0:1789579011.910096:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579011.910100:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21999 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec17c expref: 23 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.910109:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af400, rc 0) 00000100:00100000:2.0:1789579011.910242:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261385984:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 496us (746us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1789579011.910249:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 187 00000100:00100000:3.0:1789579011.922604:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.922772:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261386112 00000100:00100000:2.0:1789579011.922803:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261386112 00000100:00100000:2.0:1789579011.922850:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:2.0:1789579011.922859:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261386112:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789579011.922897:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789579011.923016:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261386112:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 157us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579011.923023:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 188 00000100:00100000:1.0:1789579011.927117:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579011.927203:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261386368 00000100:00100000:0.0:1789579011.927212:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261386368 00000100:00100000:0.0:1789579011.927265:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:0.0:1789579011.927275:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261386368:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579011.927295:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579011.927298:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789579011.927322:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f2195a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec16e expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927340:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579011.927345:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789579011.927395:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f219ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec183 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789579011.927746:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789579011.927878:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f219b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927891:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f219b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927900:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f219b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927943:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f219ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec183 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927957:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f219b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec183 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579011.927977:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939412b0f600) 00010000:00010000:0.0:1789579011.927980:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579011.927983:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789579011.928039:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+23:12346:x1876509261386368:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 766us (932us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789579011.928046:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 189 00000100:00100000:1.0:1789579011.937816:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579011.938030:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261386624 00000100:00100000:3.0:1789579011.938040:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261386624 00000100:00100000:3.0:1789579011.938104:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:3.0:1789579011.938115:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+23:12346:x1876509261386624:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789579011.938169:0:13782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579011.938329:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f219b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec183 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938346:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939412b0f600) 00010000:00010000:3.0:1789579011.938385:0:13782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579011.938412:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938426:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938436:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938452:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938458:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938465:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938506:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938513:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938519:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938587:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579011.938592:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938601:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938620:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579011.938623:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579011.938627:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938634:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f219c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938644:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938661:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938668:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938673:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579011.938677:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938683:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938691:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc8a33f9f (ffff939405f07b00) 00010000:00010000:3.0:1789579011.938694:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579011.938697:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.938703:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc8a33f9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579011.938784:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261386624:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 671us (974us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789579011.938792:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 190 00000100:00100000:3.0:1789579011.943284:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579011.943390:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261386752 00000100:00100000:1.0:1789579011.943400:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261386752 00000100:00100000:1.0:1789579011.943446:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:1.0:1789579011.943455:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+22:12346:x1876509261386752:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579011.943473:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579011.943494:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f219d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec18a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943535:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943548:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943559:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943669:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367200/0xd90373d592f219d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943693:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579011.943702:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:1.0:1789579011.943705:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789579011.943708:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367800, rc 0) 00000100:00100000:1.0:1789579011.943769:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+23:12346:x1876509261386752:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 315us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579011.943776:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 191 00000100:00100000:0.0:1789579011.963240:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579011.963406:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387008 00000100:00100000:2.0:1789579011.963419:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387008 00000100:00100000:2.0:1789579011.963480:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:2.0:1789579011.963491:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+23:12346:x1876509261387008:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789579011.963578:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.963595:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.963608:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579011.963786:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789579011.963797:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367096445464ns, next at 368096443114ns, rc = 0 00000004:00010000:2.0:1789579011.963858:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac64c216 reply state 000000002082393b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.963872:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579011.963879:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:2.0:1789579011.963891:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789579011.963895:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789579011.965301:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+25:12346:x1876509261387008:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1804us (2063us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789579011.965312:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 192 00000100:00100000:0.0:1789579011.987663:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579011.988937:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387136 00000100:00100000:3.0:1789579011.988952:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387136 00000100:00100000:3.0:1789579011.989016:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 193 00000100:00100000:3.0:1789579011.989027:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+25:12346:x1876509261387136:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579011.989052:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579011.989071:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec191 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.989139:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.989154:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579011.989171:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:3.0:1789579011.989174:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789579011.989177:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37600, rc 0) 00000100:00100000:3.0:1789579011.989228:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+26:12346:x1876509261387136:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 203us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579011.989234:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 193 00000100:00100000:3.0:1789579012.000795:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579012.000943:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387264 00000100:00100000:0.0:1789579012.000954:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387264 00000100:00100000:0.0:1789579012.001021:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789579012.001031:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942f360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261387264:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789579012.001245:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942f360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261387264:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 215us (459us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789579012.001253:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00080000:3.0:1789579012.002388:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579012.024646:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.025670:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387520 00000100:00100000:3.0:1789579012.025680:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387520 00000100:00100000:3.0:1789579012.025733:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:3.0:1789579012.025743:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+26:12346:x1876509261387520:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789579012.025949:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+27:12346:x1876509261387520:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 207us (1310us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789579012.025957:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:2.0:1789579012.044550:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.056565:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387776 00000100:00100000:3.0:1789579012.056584:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387776 00000100:00100000:1.0:1789579012.069177:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:1.0:1789579012.069191:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+27:12346:x1876509261387776:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789579012.069314:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+27:12346:x1876509261387776:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 125us (24774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579012.069321:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 194 00000100:00100000:1.0:1789579012.082007:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.082081:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261387904 00000100:00100000:2.0:1789579012.082099:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261387904 00000100:00100000:2.0:1789579012.082153:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 195 00000100:00100000:2.0:1789579012.082162:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+27:12346:x1876509261387904:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579012.082191:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579012.082212:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f219ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec198 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082292:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082306:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082318:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579012.082387:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579012.082405:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082431:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f219ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec198 expref: 29 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082462:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec198 expref: 28 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.082470:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:2.0:1789579012.082473:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789579012.082477:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aee00, rc 0) 00000100:00100000:2.0:1789579012.082794:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+28:12346:x1876509261387904:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 631us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579012.082802:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 195 00000100:00100000:1.0:1789579012.090139:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.090249:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388032 00000100:00100000:3.0:1789579012.090259:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388032 00000100:00100000:3.0:1789579012.090312:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:3.0:1789579012.090321:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261388032:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579012.090339:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579012.090381:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec19f expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579012.090407:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaacf03, blocks: 0x0 00010000:00010000:3.0:1789579012.090429:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789579012.090434:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579012.090444:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.090462:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.090474:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36e00, rc 0) 00000100:00100000:3.0:1789579012.090570:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261388032:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 249us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.090576:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:1.0:1789579012.102896:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579012.106320:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388288 00000100:00100000:0.0:1789579012.106336:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388288 00000100:00100000:0.0:1789579012.106428:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:0.0:1789579012.106440:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+28:12346:x1876509261388288:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789579012.107838:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+28:12346:x1876509261388288:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 1388us (4943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.107851:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 196 00000100:00100000:3.0:1789579012.126998:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.129155:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388416 00000100:00100000:2.0:1789579012.129168:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388416 00000100:00100000:2.0:1789579012.131702:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789579012.131723:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:12346:x1876509261388416:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579012.131742:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579012.131760:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1a6 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.131793:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.131802:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579012.131807:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579012.131812:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 9 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.131862:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.131878:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.131891:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277169152:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789579012.131979:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579012.137815:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277169152:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579012.137850:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 9 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.137871:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:3.0:1789579012.137923:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+9:12346:x1876509261388416:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 6209us (10933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.137932:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:3.0:1789579012.138036:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.138107:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388544 00000100:00100000:3.0:1789579012.138113:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388544 00010000:00010000:3.0:1789579012.138143:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.138604:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:3.0:1789579012.138615:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261388544:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579012.138630:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579012.138661:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.138675:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.138708:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a62c69/0xd90373d592f219fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec19f expref: 9 pid: 8405 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.138721:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579012.138726:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579012.138733:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.138744:0:9492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.138779:0:9492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.138792:0:9492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9492:1876509277169280:192.168.203.37@tcp:105: 00000100:00100000:3.0:1789579012.138851:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789579012.142514:0:9492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9492:1876509277169280:192.168.203.37@tcp:105: 00010000:00010000:0.0:1789579012.142643:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579012.142731:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261388544:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4118us (4694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.142743:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 87 00000100:00100000:3.0:1789579012.149425:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579012.153216:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388672 00000100:00100000:1.0:1789579012.153231:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388672 00002000:00100000:1.0:1789579012.153283:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff939304336d80 x1876509261388672/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:258/0 lens 504/0 e 0 to 0 dl 1789579023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789579012.153294:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304336d80 with x1876509261388672 ext(0->8) 00002000:00010000:1.0:1789579012.153300:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939304336d80 00000100:00100000:1.0:1789579012.153332:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789579012.153366:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261388672:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789579012.156750:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+10:2394:x1876509261388672:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 3394us (7324us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789579012.156763:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00002000:00100000:0.0:1789579012.156775:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff939304336d80 x1876509261388672/t4294967315(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:258/0 lens 504/448 e 0 to 0 dl 1789579023 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579012.156785:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304336d80 with x1876509261388672 ext(0->8) 00002000:00010000:0.0:1789579012.156790:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939304336d80 00000100:00100000:1.0:1789579012.168793:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579012.168856:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388800 00000100:00100000:0.0:1789579012.168866:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388800 00000100:00100000:0.0:1789579012.168919:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:0.0:1789579012.168930:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+28:12346:x1876509261388800:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789579012.171804:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789579012.171821:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789579012.171856:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789579012.171875:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789579012.171884:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789579012.172013:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+20:12346:x1876509261388800:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 3081us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.172024:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 197 00000100:00100000:0.0:1789579012.172477:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277169408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789579012.172537:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579012.173260:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277169408 00000100:00100000:2.0:1789579012.173269:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277169408 00000100:00100000:2.0:1789579012.173316:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789579012.173325:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277169408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789579012.173458:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789579012.173462:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789579011 00002000:00010000:2.0:1789579012.173464:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789579012.173466:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789579011 -> 1789579011 00002000:00010000:2.0:1789579012.173469:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789579012.173508:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277169408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (971us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789579012.173514:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1789579012.174507:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93930489d880/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789579012.174518:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277169408:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789579012.176477:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176493:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176501:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176508:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579012.176513:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176522:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176549:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:1.0:1789579012.176553:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789579012.176557:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.176563:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f219df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.177680:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579012.182666:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261388928 00000100:00100000:1.0:1789579012.182681:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261388928 00000100:00100000:1.0:1789579012.182737:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:1.0:1789579012.182748:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+10:2392:x1876509261388928:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000040:00080000:3.0:1789579012.185627:0:14631:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789579012.185636:0:14631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789579012.185671:0:14631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789579012.185677:0:14631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789579012.210519:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789579012.210626:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789579012.219440:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261388928:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 36684us (41757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.219461:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789579012.231154:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.231196:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389184 00000100:00100000:3.0:1789579012.231205:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389184 00000100:00100000:3.0:1789579012.231252:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:3.0:1789579012.231262:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+19:12346:x1876509261389184:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789579012.231310:0:13782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579012.231334:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363aee00/0xd90373d592f219f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec198 expref: 19 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.231367:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:3.0:1789579012.231373:0:13782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579012.231400:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.231413:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.231423:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579012.231545:0:13782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9a4afa9 reply state 0000000072310906 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.231556:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.231562:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:3.0:1789579012.231564:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579012.231574:0:13782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579012.231677:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:12346:x1876509261389184:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 416us (531us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789579012.231684:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 198 00000100:00100000:1.0:1789579012.239816:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.239900:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389312 00000100:00100000:3.0:1789579012.239910:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389312 00000100:00100000:3.0:1789579012.239973:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:3.0:1789579012.239984:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261389312:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789579012.240143:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789579012.240146:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789579011 -> 1789579009 00002000:00010000:3.0:1789579012.240149:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789579007 00002000:00010000:3.0:1789579012.240152:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789579011 -> 1789579009 00002000:00010000:3.0:1789579012.240154:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789579012.240225:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261389312:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 242us (420us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789579012.240233:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:2.0:1789579012.247629:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579012.247768:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389568 00000100:00100000:0.0:1789579012.247778:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389568 00000100:00100000:0.0:1789579012.247847:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:0.0:1789579012.247857:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+20:12346:x1876509261389568:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789579012.247923:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.247941:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.247951:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.247986:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.248000:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 20 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579012.248014:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876509277169536:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579012.248094:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58c00 going to sleep for 11 seconds 00010000:00010000:0.0:1789579012.264464:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579012.264620:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579012.264678:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6492:1876509277169536:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579012.264705:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579012.265083:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389696 00000100:00100000:1.0:1789579012.265090:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389696 00010000:00010000:1.0:1789579012.265125:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 21 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579012.265154:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 88 00000100:00100000:1.0:1789579012.265163:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+21:2395:x1876509261389696:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579012.265194:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579012.265201:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 21 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265214:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 21 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265232:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f219d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec18a expref: 21 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265246:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:1.0:1789579012.265251:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265263:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265271:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265306:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579012.265366:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+20:2395:x1876509261389696:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 189us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579012.265373:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 88 00010000:00010000:1.0:1789579012.265494:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265502:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265548:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265556:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265563:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265569:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579012.265573:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265581:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265589:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:1.0:1789579012.265592:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789579012.265596:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.265611:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21a10 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579012.265662:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+19:12346:x1876509261389568:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 17807us (18039us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789579012.265670:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 199 00000100:00100000:0.0:1789579012.290591:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579012.290665:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389824 00000100:00100000:1.0:1789579012.290676:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389824 00000100:00100000:1.0:1789579012.290731:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789579012.290742:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2392:x1876509261389824:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789579012.290783:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.290802:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.290810:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579012.290814:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789579012.290818:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.290850:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.290864:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579012.290890:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277169664:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579012.291142:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579012.299685:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.299758:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261389952 00000100:00100000:2.0:1789579012.299767:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261389952 00010000:00010000:2.0:1789579012.299802:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 9 pid: 10029 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.299856:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 89 00000100:00100000:2.0:1789579012.299865:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261389952:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579012.299879:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579012.299899:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 9 pid: 10029 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.299912:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 9 pid: 10029 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.299935:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789579012.299940:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789579012.299946:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.299954:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.299974:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579012.300023:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261389952:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579012.300030:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 89 00010000:00010000:0.0:1789579012.304773:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb01eea3/0xd90373d592f21a02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1a6 expref: 8 pid: 10029 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579012.304797:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277169664:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579012.304821:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304834:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304841:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304869:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304878:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304888:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304896:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579012.304901:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304923:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304943:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.304950:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641dcc24/0xd90373d592f21a17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579012.305171:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261389824:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 14431us (14646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.305193:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789579012.309595:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.309723:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261390208 00000100:00100000:2.0:1789579012.309732:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261390208 00000100:00100000:2.0:1789579012.309788:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 200 00000100:00100000:2.0:1789579012.309798:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+19:12346:x1876509261390208:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789579012.309884:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.309901:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.309910:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.309943:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.309958:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 19 pid: 6490 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.309971:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277169792:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789579012.310049:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01780 going to sleep for 11 seconds 00000100:00100000:2.0:1789579012.317951:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.318017:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261390336 00000100:00100000:3.0:1789579012.318026:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261390336 00010000:00010000:3.0:1789579012.318061:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 20 pid: 6490 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.318102:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 90 00000100:00100000:3.0:1789579012.318111:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+20:2394:x1876509261390336:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579012.318124:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579012.318132:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 20 pid: 6490 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.318155:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 20 pid: 6490 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.318186:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579012.318196:0:9492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.318206:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.318212:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.318231:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579012.318279:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+20:2394:x1876509261390336:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.318286:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 90 00010000:00010000:0.0:1789579012.318573:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21865 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec12f expref: 19 pid: 6490 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579012.318589:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277169792:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579012.318607:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318614:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318619:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318782:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318798:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 19 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318805:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318829:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 19 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.318842:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 19 pid: 13782 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579012.318854:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277169920:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579012.318910:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579012.330593:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.330736:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277169920:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579012.330763:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.331617:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261390464 00000100:00100000:3.0:1789579012.331626:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261390464 00010000:00010000:3.0:1789579012.331674:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 20 pid: 13782 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.331768:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 91 00000100:00100000:3.0:1789579012.331778:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+20:2395:x1876509261390464:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579012.331791:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579012.331797:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 20 pid: 13782 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331833:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 20 pid: 13782 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331853:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f219e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec191 expref: 20 pid: 13782 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331867:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:3.0:1789579012.331872:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331881:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331889:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.331917:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579012.331965:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+19:2395:x1876509261390464:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 188us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.331972:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 91 00010000:00010000:1.0:1789579012.332337:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.332346:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579012.332484:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789579012.332604:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1789579012.332635:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789579012.332719:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1876509277170048:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789579012.332769:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579012.332797:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579012.333190:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277170048 00000100:00100000:0.0:1789579012.333196:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277170048 00000100:00100000:0.0:1789579012.333236:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789579012.333244:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1876509277170048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789579012.333319:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1876509277170048:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.333326:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789579012.333373:0:6490:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789579012.333378:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93930489d880, transno 4294967316 00000100:00100000:0.0:1789579012.333390:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1876509277170048:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789579012.333497:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789579012.333672:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304196a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1876509277170176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789579012.333708:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579012.333724:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579012.333791:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277170176 00000100:00100000:0.0:1789579012.333796:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277170176 00000100:00100000:0.0:1789579012.333818:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789579012.333898:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6490:x1876509277170176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789579012.333985:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6490:x1876509277170176:12345-0@lo:1000:mdt00_000.0 Request processed in 160us (275us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789579012.333991:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789579012.334022:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304196a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6490:1876509277170176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789579012.334051:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334060:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334068:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334073:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579012.334077:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334083:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334094:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:0.0:1789579012.334097:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579012.334102:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334117:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a25 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334139:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334146:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334152:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334158:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579012.334161:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334167:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334332:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:0.0:1789579012.334336:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579012.334339:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579012.334346:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21961 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.335487:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.335503:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.335512:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.335552:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579012.335581:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 22 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579012.335593:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277170304:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579012.335685:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579012.341060:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579012.341343:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261390592 00000100:00100000:3.0:1789579012.341386:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261390592 00010000:00010000:3.0:1789579012.341425:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 23 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579012.341459:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 92 00000100:00100000:3.0:1789579012.341469:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+23:2394:x1876509261390592:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579012.341493:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579012.341500:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 23 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.341514:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 23 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.341545:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:3.0:1789579012.341551:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.341559:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.341567:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.341586:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579012.341634:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+23:2394:x1876509261390592:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 166us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579012.341642:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 92 00010000:00010000:2.0:1789579012.347890:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f2197d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec175 expref: 22 pid: 6492 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.347913:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6490:1876509277170304:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579012.347936:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347954:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347960:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347973:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347979:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347986:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.347991:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579012.347996:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348003:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348019:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579012.348022:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579012.348028:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348033:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21a2c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348042:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348053:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348058:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348063:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579012.348066:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348071:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348078:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939410126d00) 00010000:00010000:2.0:1789579012.348080:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579012.348083:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.348089:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21a1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579012.348257:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261390208:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 38461us (38669us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789579012.348266:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 200 00000020:00080000:2.0:1789579012.348272:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789579012.348386:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789579012.348390:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789579012.348907:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789579012.348917:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789579012.352425:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579012.352859:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261390848 00000100:00100000:2.0:1789579012.352880:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261390848 00000100:00100000:2.0:1789579012.352935:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:2.0:1789579012.352945:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b600850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12346:x1876509261390848:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789579012.353338:0:6493:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789579012.353496:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789579012.353820:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353846:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353858:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353866:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353873:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353879:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579012.353945:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789579012.354031:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b600850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+23:12346:x1876509261390848:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 1087us (1613us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789579012.354040:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000020:00080000:2.0:1789579012.354045:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789579012.358822:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579012.358842:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.358854:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579012.358858:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.358878:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.358893:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:3.0:1789579012.358897:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789579012.358902:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.358908:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21a33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579012.358920:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579012.358922:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579012.358924:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579012.451754:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789579012.451776:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277170432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579012.451843:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579012.452072:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277170560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579012.452095:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579012.452791:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277170432 00000100:00100000:0.0:1789579012.452801:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277170432 00000100:00100000:0.0:1789579012.452848:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277170560 00000100:00100000:0.0:1789579012.452862:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277170560 00000100:00100000:0.0:1789579012.452879:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789579012.452887:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277170432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579012.452917:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789579012.453892:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789579012.453906:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277170560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579012.453929:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789579012.454003:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277170560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579012.454010:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789579012.454151:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277170560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579012.454779:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277170432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1890us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579012.454787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789579012.454916:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277170432:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789579013.284687:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789579013.989916:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789579013.989942:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00010000:00010000:2.0:1789579014.309151:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789579014.896569:0:14683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789579014.896582:0:14683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579014.896655:0:14683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789579014.896664:0:14683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789579015.108506:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.108667:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261391104 00000100:00100000:3.0:1789579015.108681:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261391104 00000100:00100000:3.0:1789579015.108790:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00100000:3.0:1789579015.108805:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+23:12365:x1876509261391104:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579015.108839:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579015.108882:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1ad expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.109022:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21a41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.109039:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21a41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.109055:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21a41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579015.109068:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789579015.109415:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ad expref: 26 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.109442:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21a41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ad expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.109453:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579015.109456:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789579015.109461:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37600, rc 0) 00000100:00100000:3.0:1789579015.109854:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+25:12365:x1876509261391104:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1052us (1373us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789579015.109862:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 201 00000100:00080000:0.0:1789579015.113789:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579015.119466:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579015.119649:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261391232 00000100:00100000:0.0:1789579015.119662:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261391232 00000100:00100000:0.0:1789579015.119752:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:0.0:1789579015.119763:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+25:12365:x1876509261391232:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789579015.119863:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.119885:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.119900:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.119920:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.119929:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.119960:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120079:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120088:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120095:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579015.120173:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120189:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120195:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120201:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120207:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579015.120212:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120221:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120235:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579015.120244:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579015.120251:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120257:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21a4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120276:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120282:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120288:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120293:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579015.120295:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120302:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120309:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939302a5f500) 00010000:00010000:0.0:1789579015.120312:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579015.120314:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120320:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21a56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120335:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120380:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120387:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120392:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579015.120396:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120402:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120410:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939302a5ff00) 00010000:00010000:0.0:1789579015.120412:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579015.120415:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.120421:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21a5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579015.120530:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+25:12365:x1876509261391232:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 766us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579015.120539:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 202 00000100:00100000:2.0:1789579015.258870:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.259002:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261391488 00000100:00100000:1.0:1789579015.259016:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261391488 00000100:00100000:1.0:1789579015.259098:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:1.0:1789579015.259110:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+25:12368:x1876509261391488:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579015.259136:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579015.259283:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f21a64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1b4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259545:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259566:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259582:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259622:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259641:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259649:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259804:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259813:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259820:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579015.259832:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789579015.259947:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259956:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259963:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259969:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.259975:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.259995:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260010:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579015.260014:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.260021:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260029:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21a6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260045:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260051:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260058:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260064:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.260067:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260074:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260082:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93940905b600) 00010000:00010000:1.0:1789579015.260084:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.260087:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260104:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260173:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f21a64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 28 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260190:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 27 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.260198:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579015.260201:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579015.260203:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366800, rc 0) 00000100:00100000:1.0:1789579015.261828:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+27:12368:x1876509261391488:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2704us (2957us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789579015.261844:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 203 00000100:00100000:0.0:1789579015.268644:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.269543:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261391616 00000100:00100000:3.0:1789579015.269560:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261391616 00000100:00100000:3.0:1789579015.269665:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:3.0:1789579015.269680:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+27:12368:x1876509261391616:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:3.0:1789579015.269813:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269841:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269856:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269902:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269910:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269918:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269925:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579015.269930:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269938:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269951:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579015.269955:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789579015.269960:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.269968:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21a87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579015.270093:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+27:12368:x1876509261391616:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 416us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579015.270102:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 204 00000100:00100000:1.0:1789579015.274826:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.275122:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261391872 00000100:00100000:3.0:1789579015.275134:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261391872 00000100:00100000:3.0:1789579015.275257:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:3.0:1789579015.275270:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+27:12368:x1876509261391872:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579015.275852:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+28:12368:x1876509261391872:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 582us (1037us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789579015.275862:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00010000:00010000:3.0:1789579015.332198:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579015.352096:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.352744:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392128 00000100:00100000:1.0:1789579015.352760:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392128 00000100:00100000:1.0:1789579015.353192:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:1.0:1789579015.353444:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+28:11892:x1876509261392128:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579015.353468:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579015.353488:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f21a8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1bb expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.353592:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.353618:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 29 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.353637:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.353671:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 29 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.353685:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 29 pid: 6490 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579015.353708:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277170688:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579015.354371:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579015.366767:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.367060:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393048ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277170688:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579015.367086:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579015.367168:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392256 00000100:00100000:2.0:1789579015.367175:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392256 00010000:00010000:2.0:1789579015.367213:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 30 pid: 6490 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579015.367249:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 93 00000100:00100000:2.0:1789579015.367257:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+30:2394:x1876509261392256:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579015.367277:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579015.367284:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 30 pid: 6490 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367295:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 30 pid: 6490 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367314:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366800/0xd90373d592f21a79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1b4 expref: 30 pid: 6490 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367326:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:2.0:1789579015.367331:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367339:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367368:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.367389:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579015.367442:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+29:2394:x1876509261392256:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 185us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579015.367449:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 93 00010000:00010000:1.0:1789579015.367640:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.367648:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579015.367664:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789579015.367800:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f21a8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 30 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.367929:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 29 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.367951:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579015.367953:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789579015.367956:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366600, rc 0) 00000100:00100000:1.0:1789579015.368016:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+29:11892:x1876509261392128:12345-192.168.203.37@tcp:101:bash.0 Request processed in 14578us (15930us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789579015.368022:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 205 00000100:00100000:1.0:1789579015.374053:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579015.374204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392384 00000100:00100000:2.0:1789579015.374214:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392384 00000100:00100000:2.0:1789579015.374318:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:2.0:1789579015.374330:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+29:11892:x1876509261392384:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789579015.374394:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579015.374414:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21aa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374446:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21aaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374470:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374481:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374593:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c2 expref: 31 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374613:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c2 expref: 30 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.374634:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:2.0:1789579015.374637:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579015.374640:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:2.0:1789579015.374697:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+30:11892:x1876509261392384:12345-192.168.203.37@tcp:101:bash.0 Request processed in 370us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579015.374704:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 206 00000100:00100000:2.0:1789579015.378855:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579015.378968:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392640 00000100:00100000:0.0:1789579015.378977:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392640 00000100:00100000:0.0:1789579015.379037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 207 00000100:00100000:0.0:1789579015.379048:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+30:11892:x1876509261392640:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:0.0:1789579015.379305:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.379323:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.379335:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789579015.379408:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789579015.379429:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a76c107 reply state 0000000002661cf1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.379442:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.379460:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:0.0:1789579015.379464:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579015.379468:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789579015.379508:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789579015.379596:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+34:11892:x1876509261392640:12345-192.168.203.37@tcp:36:bash.0 Request processed in 550us (749us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789579015.379604:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 207 00000020:00080000:0.0:1789579015.379608:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789579015.383639:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.383722:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392768 00000100:00100000:1.0:1789579015.383734:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392768 00000100:00100000:1.0:1789579015.383795:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:1.0:1789579015.383816:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+34:11892:x1876509261392768:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579015.383842:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579015.383863:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21ab8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1c9 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.383919:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c9 expref: 35 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.383930:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c9 expref: 35 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.383944:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579015.383947:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789579015.383949:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367600, rc 0) 00000100:00100000:1.0:1789579015.384023:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+35:11892:x1876509261392768:12345-192.168.203.37@tcp:101:bash.0 Request processed in 221us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579015.384039:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 208 00000100:00100000:1.0:1789579015.390718:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.390989:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261392896 00000100:00100000:3.0:1789579015.390998:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261392896 00000100:00100000:3.0:1789579015.391070:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:3.0:1789579015.391081:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:11892:x1876509261392896:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579015.391099:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579015.391120:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1d0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579015.391145:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aaacf01, atime: 0x6aaaceff, ctime: 0x6aaacf01, blocks: 0x8 00010000:00010000:3.0:1789579015.391182:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1789579015.391187:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579015.391196:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.391215:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.391227:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:3.0:1789579015.391292:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:11892:x1876509261392896:12345-192.168.203.37@tcp:101:bash.0 Request processed in 213us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579015.391298:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00080000:0.0:1789579015.391446:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579015.395484:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579015.395587:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393024 00000100:00100000:0.0:1789579015.395597:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393024 00002000:00010000:0.0:1789579015.395645:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789579015.395649:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93930489dc00 with x1876509261393024 ext(0->18446744073709551615) 00002000:00010000:0.0:1789579015.395661:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93930489dc00. 00000100:00100000:0.0:1789579015.395701:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579015.395711:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261393024:12345-192.168.203.37@tcp:10:bash.0 00002000:00010000:0.0:1789579015.395954:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789579015.395958:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789579009 -> 1789579014 00002000:00010000:0.0:1789579015.395960:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789579007 -> 1789579007 00002000:00010000:0.0:1789579015.395962:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789579009 -> 1789579014 00002000:00010000:0.0:1789579015.395965:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789579015.396072:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261393024:12345-192.168.203.37@tcp:10:bash.0 Request processed in 361us (597us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789579015.396081:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00002000:00010000:0.0:1789579015.396084:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789579015.396087:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93930489dc00 with x1876509261393024 ext(0->18446744073709551615) 00002000:00010000:0.0:1789579015.396093:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93930489dc00. 00000100:00100000:2.0:1789579015.530027:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.530129:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393152 00000100:00100000:1.0:1789579015.530138:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393152 00000100:00100000:1.0:1789579015.530209:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:1.0:1789579015.530220:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+35:12382:x1876509261393152:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:1.0:1789579015.530287:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530303:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530314:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530328:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530335:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530341:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530466:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530476:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530483:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579015.530544:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530556:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530563:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530570:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530576:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.530580:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530587:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530598:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579015.530601:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.530606:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530613:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21ac6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530635:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530641:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530654:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530658:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.530661:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530666:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530674:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93940905b600) 00010000:00010000:1.0:1789579015.530677:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.530679:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530684:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21acd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530699:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530705:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530710:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530714:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.530716:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530729:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530737:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579015.530738:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.530742:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.530746:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366200/0xd90373d592f21ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579015.530810:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+35:12382:x1876509261393152:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 591us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579015.530817:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 209 00000100:00100000:2.0:1789579015.682496:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.682579:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393408 00000100:00100000:3.0:1789579015.682589:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393408 00000100:00100000:3.0:1789579015.682659:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:3.0:1789579015.682669:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+35:12385:x1876509261393408:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579015.682757:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579015.682779:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21adb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1d7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682849:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682863:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682874:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682905:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682913:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.682930:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683037:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21af0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683046:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21af0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683054:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21af0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579015.683063:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789579015.683135:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683143:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683160:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683167:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579015.683171:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683189:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683202:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579015.683205:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579015.683211:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683217:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21ae2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683233:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683239:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683244:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683249:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579015.683252:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683258:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683265:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:3.0:1789579015.683267:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579015.683270:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683285:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21ae9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683324:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21adb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d7 expref: 38 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683339:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21af0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d7 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579015.683347:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579015.683415:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789579015.683418:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6000, rc 0) 00000100:00100000:3.0:1789579015.683478:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+37:12385:x1876509261393408:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 810us (990us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789579015.683485:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 210 00000100:00100000:3.0:1789579015.709542:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579015.709760:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393536 00000100:00100000:2.0:1789579015.709771:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393536 00000100:00100000:2.0:1789579015.709822:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:2.0:1789579015.709832:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+37:12385:x1876509261393536:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:2.0:1789579015.709899:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.709915:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 37 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.709924:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.709956:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 37 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.709970:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 37 pid: 13782 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579015.709984:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277170816:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789579015.710110:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579015.725215:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579015.725343:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277170816:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579015.725398:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579015.725602:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393792 00000100:00100000:1.0:1789579015.725610:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393792 00000100:00100000:1.0:1789579015.725671:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:1.0:1789579015.725681:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+38:6162:x1876509261393792:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789579015.725957:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+39:6162:x1876509261393792:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 275us (750us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789579015.725965:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:3.0:1789579015.741432:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579015.741510:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261393920 00000100:00100000:0.0:1789579015.741521:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261393920 00010000:00010000:0.0:1789579015.741559:0:13705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 39 pid: 13782 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579015.741596:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 94 00000100:00100000:0.0:1789579015.741605:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+39:2395:x1876509261393920:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579015.741716:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579015.741724:0:13705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 39 pid: 13782 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741738:0:13705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 39 pid: 13782 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741771:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366600/0xd90373d592f21a95 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1bb expref: 39 pid: 13782 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741785:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:0.0:1789579015.741791:0:13705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741801:0:13705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741808:0:13705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579015.741836:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579015.741887:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+38:2395:x1876509261393920:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 282us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579015.741894:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 94 00010000:00010000:2.0:1789579015.742069:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742078:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742115:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742122:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742129:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742135:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579015.742139:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742146:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742162:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:2.0:1789579015.742165:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579015.742168:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579015.742174:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579015.742215:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+37:12385:x1876509261393536:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 32385us (32683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579015.742222:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 211 00000100:00100000:2.0:1789579015.751885:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.752141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394176 00000100:00100000:1.0:1789579015.752167:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394176 00000100:00100000:1.0:1789579015.752218:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:1.0:1789579015.752228:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+37:12385:x1876509261394176:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789579015.752475:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+38:12385:x1876509261394176:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 247us (597us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789579015.752500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:1.0:1789579015.810470:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.810508:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.810546:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579015.810646:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394304 00000100:00100000:2.0:1789579015.810657:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394304 00000100:00100000:2.0:1789579015.810710:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 387 00000100:00100000:2.0:1789579015.810719:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261394304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579015.810783:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2394:x1876509261394304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579015.810790:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 387 00000100:00100000:0.0:1789579015.810978:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394432 00000100:00100000:0.0:1789579015.810983:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394432 00000100:00100000:0.0:1789579015.811020:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394688 00000100:00100000:0.0:1789579015.811023:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394688 00000100:00100000:0.0:1789579015.811044:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 315 00000100:00100000:0.0:1789579015.811051:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261394432:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579015.811102:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261394432:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 51us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579015.811108:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 315 00000100:00100000:0.0:1789579015.811122:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 316 00000100:00100000:0.0:1789579015.811143:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261394688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579015.811168:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261394688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579015.811173:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 316 00000100:00080000:0.0:1789579015.811190:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789579015.811193:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579015.822654:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.822697:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579015.822787:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394816 00000100:00100000:3.0:1789579015.822796:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394816 00000100:00100000:3.0:1789579015.822868:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 317 00000100:00100000:3.0:1789579015.822878:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261394816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579015.822948:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261394816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579015.822955:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 317 00000100:00080000:0.0:1789579015.823022:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579015.823083:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261394560 00000100:00100000:2.0:1789579015.823088:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261394560 00000100:00100000:2.0:1789579015.823136:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:2.0:1789579015.823143:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261394560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579015.823170:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2394:x1876509261394560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579015.823176:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00080000:0.0:1789579015.823385:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579015.958198:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.958294:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261395072 00000100:00100000:1.0:1789579015.958302:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261395072 00000100:00100000:1.0:1789579015.958381:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 212 00000100:00100000:1.0:1789579015.958391:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+38:12395:x1876509261395072:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:1.0:1789579015.958412:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579015.958429:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21b05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1de expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958493:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958521:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958534:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958557:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958564:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958588:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958705:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21b1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958715:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958723:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21b1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579015.958732:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789579015.958803:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958811:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958818:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958824:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.958829:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958836:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958848:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579015.958851:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.958862:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958869:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958883:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958888:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958894:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958899:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579015.958902:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958907:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958914:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93940905b600) 00010000:00010000:1.0:1789579015.958916:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579015.958918:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958923:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958970:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21b05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1de expref: 41 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.958994:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21b1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1de expref: 40 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579015.959002:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579015.959005:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579015.959007:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366a00, rc 0) 00000100:00100000:1.0:1789579015.959156:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+40:12395:x1876509261395072:12345-192.168.203.37@tcp:101:cat.0 Request processed in 766us (967us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789579015.959163:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 212 00000100:00100000:2.0:1789579015.969538:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579015.969718:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261395328 00000100:00100000:1.0:1789579015.969729:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261395328 00000100:00100000:1.0:1789579015.969796:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:1.0:1789579015.969808:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+40:12395:x1876509261395328:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:1.0:1789579015.970236:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+41:12395:x1876509261395328:12345-192.168.203.37@tcp:35:cat.0 Request processed in 429us (724us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789579015.970243:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:2.0:1789579016.002451:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.002653:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261395584 00000100:00100000:3.0:1789579016.002664:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261395584 00000100:00100000:3.0:1789579016.002748:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:3.0:1789579016.002767:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+41:12397:x1876509261395584:12345-192.168.203.37@tcp:36:rm.0 00010000:00010000:3.0:1789579016.002841:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789579016.002870:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21ab8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c9 expref: 41 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002892:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366a00/0xd90373d592f21b1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1de expref: 40 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002906:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21af0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d7 expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002921:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae200/0xd90373d592f21aaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1c2 expref: 38 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002931:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579016.002936:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579016.002957:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002970:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002980:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.002994:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003001:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003015:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003089:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003098:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003105:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579016.003544:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1789579016.003555:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371136203581ns, next at 372136201044ns, rc = 0 00010000:00010000:3.0:1789579016.003596:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003604:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003630:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003640:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003646:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003652:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003689:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579016.003725:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003732:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003739:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003745:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579016.003749:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003757:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003765:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579016.003767:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579016.003772:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789579016.003773:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003777:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003785:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579016.003789:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003805:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21b36 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003807:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003833:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:0.0:1789579016.003836:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789579016.003840:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003842:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003849:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b3d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003853:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003864:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.003868:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579016.003871:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579016.003877:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.003883:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579016.003884:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003893:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003902:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579016.003905:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579016.003908:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003915:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21b28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579016.003926:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d74127d reply state 00000000b6b835ac transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003935:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.003950:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:3.0:1789579016.003952:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579016.003955:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579016.004034:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+39:12397:x1876509261395584:12345-192.168.203.37@tcp:36:rm.0 Request processed in 1276us (1591us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789579016.004043:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 213 00000100:00100000:0.0:1789579016.149963:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579016.150065:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261395840 00000100:00100000:1.0:1789579016.150075:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261395840 00000100:00100000:1.0:1789579016.150132:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 214 00000100:00100000:1.0:1789579016.150142:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+39:12403:x1876509261395840:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579016.150182:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579016.150201:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21b44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1e5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150293:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150318:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150330:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150343:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150395:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150402:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789579016.150715:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789579016.150859:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150869:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150877:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150906:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150913:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150920:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150933:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579016.150937:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150945:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150956:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579016.150960:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579016.150964:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150971:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f21b4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579016.150983:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1b2394 reply state 000000009bc1ed9c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150993:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.150999:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:1.0:1789579016.151001:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789579016.151004:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789579016.151029:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366000/0xd90373d592f21b44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 42 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.151043:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.151061:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:1.0:1789579016.151064:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579016.151066:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367000, rc 0) 00000100:00100000:1.0:1789579016.151442:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+42:12403:x1876509261395840:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1300us (1486us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789579016.151450:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 214 00000100:00100000:0.0:1789579016.166969:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.167050:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261395968 00000100:00100000:3.0:1789579016.167059:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261395968 00000100:00100000:3.0:1789579016.167117:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:3.0:1789579016.167137:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261395968:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579016.167171:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579016.167193:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1ec expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579016.167218:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579016.167239:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789579016.167243:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579016.167252:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.167271:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.167284:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789579016.167345:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261395968:12345-192.168.203.37@tcp:101:bash.0 Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.167372:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789579016.178161:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.178283:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261396096 00000100:00100000:3.0:1789579016.178293:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261396096 00000100:00100000:3.0:1789579016.178388:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789579016.178401:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:12403:x1876509261396096:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579016.178418:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579016.178435:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1f3 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.178485:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.178494:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579016.178499:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579016.178505:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.178538:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.178552:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 7 pid: 8405 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579016.178566:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277170944:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579016.178668:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789579016.183848:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.183939:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261396224 00000100:00100000:0.0:1789579016.183948:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261396224 00010000:00010000:0.0:1789579016.183987:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 8 pid: 8405 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579016.184029:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:0.0:1789579016.184038:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261396224:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579016.184053:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579016.184074:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 8 pid: 8405 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.184089:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 8 pid: 8405 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.184112:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579016.184117:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579016.184125:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.184135:0:9492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.184188:0:9492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579016.184224:0:9492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9492:1876509277171072:192.168.203.37@tcp:105: 00000100:00100000:0.0:1789579016.184314:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95180 going to sleep for 11 seconds 00010000:00010000:3.0:1789579016.186495:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21b67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ec expref: 8 pid: 8405 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579016.186518:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1876509277170944:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579016.186546:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.186561:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37a00, rc 0) 00000100:00100000:3.0:1789579016.186638:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:12403:x1876509261396096:12345-192.168.203.37@tcp:101:bash.0 Request processed in 8239us (8499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.186647:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789579016.188037:0:9492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9492:1876509277171072:192.168.203.37@tcp:105: 00010000:00010000:3.0:1789579016.188055:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579016.188101:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261396224:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 4063us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.188110:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 95 00000100:00100000:3.0:1789579016.196203:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.197410:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261396480 00000100:00100000:0.0:1789579016.197422:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261396480 00000100:00100000:0.0:1789579016.197479:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:0.0:1789579016.197490:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+42:12403:x1876509261396480:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:0.0:1789579016.197796:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+43:12403:x1876509261396480:12345-192.168.203.37@tcp:35:bash.0 Request processed in 307us (1601us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789579016.197804:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00010000:00010000:3.0:1789579016.356584:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579016.453167:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579016.453240:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261396608 00000100:00100000:1.0:1789579016.453250:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261396608 00000100:00100000:1.0:1789579016.453306:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:1.0:1789579016.453316:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+43:12419:x1876509261396608:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579016.453338:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579016.453390:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21b75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec1fa expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453452:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453466:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453478:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579016.453518:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789579016.453523:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579016.453539:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453584:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21b75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1fa expref: 45 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453602:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1fa expref: 44 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.453610:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579016.453613:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579016.453628:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367400, rc 0) 00000100:00100000:1.0:1789579016.453694:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+44:12419:x1876509261396608:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 378us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579016.453702:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 215 00000100:00100000:2.0:1789579016.458005:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.458089:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261396864 00000100:00100000:3.0:1789579016.458097:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261396864 00000100:00100000:3.0:1789579016.458160:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 216 00000100:00100000:3.0:1789579016.458175:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+44:12419:x1876509261396864:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579016.458196:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579016.458215:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21b83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec201 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.458313:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.458327:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.458339:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579016.458645:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789579016.458748:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21b83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec201 expref: 47 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.458781:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec201 expref: 46 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.458790:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:3.0:1789579016.458793:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579016.458797:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36c00, rc 0) 00000100:00100000:3.0:1789579016.458861:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+46:12419:x1876509261396864:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 687us (864us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789579016.458869:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 216 00000100:00100000:2.0:1789579016.462413:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.462597:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397120 00000100:00100000:3.0:1789579016.462605:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397120 00000100:00100000:3.0:1789579016.462675:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789579016.462685:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+46:2393:x1876509261397120:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579016.462698:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579016.462719:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21b8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec201 expref: 46 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.462740:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:3.0:1789579016.462745:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579016.462791:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+45:2393:x1876509261397120:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 109us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.462799:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789579016.467796:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.468317:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397248 00000100:00100000:0.0:1789579016.468327:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397248 00000100:00100000:0.0:1789579016.468417:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:0.0:1789579016.468428:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+45:12419:x1876509261397248:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579016.468450:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579016.468468:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21b98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec208 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.468566:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.468581:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.468593:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579016.468631:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789579016.468726:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21b98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec208 expref: 48 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.468744:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec208 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.468754:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:0.0:1789579016.468756:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789579016.468759:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437a00, rc 0) 00000100:00100000:0.0:1789579016.468813:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+47:12419:x1876509261397248:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 387us (1028us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789579016.468821:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 217 00000100:00100000:2.0:1789579016.485588:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.486036:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397376 00000100:00100000:3.0:1789579016.486047:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397376 00000100:00100000:3.0:1789579016.486102:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:3.0:1789579016.486126:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+6:2394:x1876509261397376:12345-192.168.203.37@tcp:1:lfs.0 00010000:00010000:3.0:1789579016.486180:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.486202:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 6 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.486212:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579016.486217:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789579016.486222:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.486257:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 6 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.486270:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 6 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579016.486285:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277171200:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579016.486989:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789579016.491550:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1876509277171200:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579016.491576:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579016.492997:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.500322:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397504 00000100:00100000:0.0:1789579016.500338:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397504 00002000:00100000:0.0:1789579016.500410:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff939302b4ea00 x1876509261397504/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:262/0 lens 504/0 e 0 to 0 dl 1789579027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579016.500422:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939302b4ea00 with x1876509261397504 ext(0->8) 00010000:00010000:0.0:1789579016.500431:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 7 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.500449:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 7 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579016.500458:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939302b4ea00 00000100:00100000:0.0:1789579016.500554:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789579016.500577:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261397504:12345-192.168.203.37@tcp:4:lfs.0 00000100:00100000:0.0:1789579016.505579:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261397504:12345-192.168.203.37@tcp:4:lfs.0 Request processed in 4994us (12577us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789579016.505592:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00002000:00100000:0.0:1789579016.505604:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff939302b4ea00 x1876509261397504/t4294967309(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:262/0 lens 504/448 e 0 to 0 dl 1789579027 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579016.505628:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939302b4ea00 with x1876509261397504 ext(0->8) 00010000:00010000:0.0:1789579016.505640:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.505660:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579016.505669:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939302b4ea00 00000100:00100000:2.0:1789579016.508676:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.509775:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397632 00000100:00100000:3.0:1789579016.509785:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397632 00010000:00010000:3.0:1789579016.509837:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579016.509878:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 96 00000100:00100000:3.0:1789579016.509888:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261397632:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579016.509919:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789579016.509936:0:6475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789579016.509940:0:6475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789579015 00002000:00010000:3.0:1789579016.509942:0:6475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789579015 00002000:00010000:3.0:1789579016.509945:0:6475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789579015 00002000:00010000:3.0:1789579016.509947:0:6475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789579016.509953:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.509966:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.509987:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f21b6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1f3 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.510003:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789579016.510007:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789579016.510013:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.510023:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.510066:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579016.510115:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261397632:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 227us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.510122:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 96 00010000:00010000:1.0:1789579016.510277:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510287:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510307:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510316:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510325:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510343:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579016.510347:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510390:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510402:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.510409:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f21bad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579016.510455:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261397376:12345-192.168.203.37@tcp:1:lfs.0 Request processed in 24330us (24875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579016.510463:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:2.0:1789579016.513311:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579016.513501:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261397888 00000100:00100000:1.0:1789579016.513510:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261397888 00000100:00100000:1.0:1789579016.513550:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:1.0:1789579016.513560:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b603050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+47:12419:x1876509261397888:12345-192.168.203.37@tcp:35:lfs.0 00000004:00010000:1.0:1789579016.513612:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec208 expref: 47 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579016.513785:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789579016.513817:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789579016.514103:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789579016.514135:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.514306:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 51 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.514316:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.514347:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 51 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.514390:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 51 pid: 6492 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579016.514404:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876509277171328:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579016.514465:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393023596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579016.516793:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6494:1876509277171328:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579016.516817:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579016.522786:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.523081:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398016 00000100:00100000:3.0:1789579016.523091:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398016 00010000:00010000:3.0:1789579016.523131:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 52 pid: 6492 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579016.523186:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 97 00000100:00100000:3.0:1789579016.523198:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+52:2395:x1876509261398016:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579016.523213:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579016.523220:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 52 pid: 6492 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523234:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 52 pid: 6492 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523255:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21b59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1e5 expref: 52 pid: 6492 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523270:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:3.0:1789579016.523275:0:9492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523284:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523292:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.523323:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579016.523421:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+51:2395:x1876509261398016:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 224us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.523443:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 97 00010000:00010000:1.0:1789579016.523541:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.523550:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789579016.523665:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789579016.523778:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789579016.523876:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277171456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789579016.523920:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579016.523955:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789579016.525421:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277171456 00000100:00100000:3.0:1789579016.525432:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277171456 00000100:00100000:3.0:1789579016.525499:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789579016.525509:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277171456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789579016.525607:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277171456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.525623:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789579016.525765:0:6494:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1789579016.525772:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1789579016.525794:0:6494:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93930489ed80, transno 4294967308 00000100:00100000:1.0:1789579016.525818:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277171456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789579016.525942:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1789579016.525995:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277171584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789579016.526027:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579016.526047:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789579016.526100:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277171584 00000100:00100000:2.0:1789579016.526105:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277171584 00000100:00100000:2.0:1789579016.526138:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789579016.526146:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6494:x1876509277171584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789579016.526243:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6494:x1876509277171584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (214us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789579016.526249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1789579016.526318:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579016.526404:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6494:1876509277171584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789579016.526437:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789579016.526467:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526475:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526483:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526489:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579016.526492:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526499:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526530:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:1.0:1789579016.526534:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789579016.526539:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579016.526545:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367800/0xd90373d592f21bb4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789579016.526641:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789579016.526701:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789579016.526712:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371659360504ns, next at 372659358467ns, rc = 0 00000001:00080000:1.0:1789579016.526718:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1789579016.526740:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93940905b600) 00010000:00010000:1.0:1789579016.526743:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789579016.526749:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437a00/0xd90373d592f21b9f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec208 expref: 55 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579016.526839:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b603050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+54:12419:x1876509261397888:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 13280us (13534us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789579016.526848:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000020:00080000:1.0:1789579016.526852:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789579016.541209:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.541405:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398144 00000100:00100000:3.0:1789579016.541415:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398144 00000100:00100000:3.0:1789579016.541464:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 218 00000100:00100000:3.0:1789579016.541474:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+54:12419:x1876509261398144:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579016.541496:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579016.541517:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21bbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec20f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.541574:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec20f expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.541590:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec20f expref: 55 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.541610:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579016.541626:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789579016.541631:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37a00, rc 0) 00000100:00100000:3.0:1789579016.541683:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+55:12419:x1876509261398144:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 210us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.541701:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 218 00000100:00100000:2.0:1789579016.545765:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.546170:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398400 00000100:00100000:3.0:1789579016.546180:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398400 00000100:00100000:3.0:1789579016.546265:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:3.0:1789579016.546277:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+55:12419:x1876509261398400:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579016.546542:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+56:12419:x1876509261398400:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 267us (786us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789579016.546550:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789579016.548040:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277171712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579016.548100:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579016.548164:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277171712 00000100:00100000:0.0:1789579016.548170:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277171712 00000100:00100000:0.0:1789579016.548214:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789579016.548223:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277171712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579016.548248:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789579016.548288:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277171712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.548295:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789579016.548329:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579016.548606:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277171712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579016.548677:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277171840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579016.548706:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579016.548735:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277171840 00000100:00100000:0.0:1789579016.548739:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277171840 00000100:00100000:0.0:1789579016.548763:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789579016.548769:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943b4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277171840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579016.548780:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789579016.548810:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943b4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277171840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.548816:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789579016.549000:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579016.549020:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277171840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789579016.554883:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277171968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579016.554956:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555015:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277171968 00000100:00100000:2.0:1789579016.555023:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277171968 00000100:00100000:2.0:1789579016.555079:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789579016.555087:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277171968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789579016.555106:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789579016.555160:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277171968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.555167:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789579016.555190:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579016.555223:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277171968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579016.555340:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277172352:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555402:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555422:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277172864:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555464:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789579016.555468:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277172224:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555488:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555506:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277172736:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555527:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555550:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172864 00000100:00100000:2.0:1789579016.555554:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172864 00000100:00100000:2.0:1789579016.555586:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172224 00000100:00100000:2.0:1789579016.555589:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172224 00000100:00100000:2.0:1789579016.555606:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172736 00000100:00100000:2.0:1789579016.555608:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172736 00000100:00100000:2.0:1789579016.555634:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789579016.555641:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277172864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555676:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277172864:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.555682:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789579016.555697:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789579016.555702:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277172224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555739:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277172224:12345-0@lo:400:kworker.0 Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.555745:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789579016.555756:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789579016.555761:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277172736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555782:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277172736:12345-0@lo:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.555787:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:2.0:1789579016.555803:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789579016.555806:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579016.555814:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172352 00000100:00100000:2.0:1789579016.555817:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172352 00000100:00100000:2.0:1789579016.555857:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789579016.555864:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277172352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555895:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277172352:12345-0@lo:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.555900:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789579016.555918:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277172480:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555941:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555957:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277172992:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.555977:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.555992:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789579016.555998:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277172096:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556023:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.556049:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277172608:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556079:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.556095:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277173120:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556111:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579016.556131:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172096 00000100:00100000:2.0:1789579016.556134:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172096 00000100:00100000:2.0:1789579016.556160:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789579016.556167:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277172096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556200:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277172096:12345-0@lo:400:kworker.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.556206:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789579016.556231:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172608 00000100:00100000:2.0:1789579016.556235:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172608 00000100:00100000:2.0:1789579016.556252:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789579016.556257:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277172608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556284:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277172608:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.556290:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789579016.556305:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172480 00000100:00100000:2.0:1789579016.556309:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172480 00000100:00100000:2.0:1789579016.556323:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277172992 00000100:00100000:2.0:1789579016.556326:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277172992 00000100:00100000:2.0:1789579016.556344:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277173120 00000100:00100000:2.0:1789579016.556346:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277173120 00000100:00100000:2.0:1789579016.556381:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789579016.556386:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277172480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556411:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277172480:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.556424:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789579016.556437:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789579016.556443:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277172992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556471:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277172992:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.556477:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789579016.556488:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789579016.556493:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277173120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556519:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277173120:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.556525:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:2.0:1789579016.556539:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789579016.556542:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579016.556571:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277172224:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556582:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277172736:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556591:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277172352:0@lo:400:kworker.0 00010000:00080000:2.0:1789579016.556602:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939402aa4e00 x1876509277172864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579016.556613:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939402aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277172864:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556652:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277172096:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556661:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277172608:0@lo:400:kworker.0 00010000:00080000:2.0:1789579016.556670:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a4000 x1876509277173120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579016.556684:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277173120:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556696:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277172480:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.556704:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277172992:0@lo:400:kworker.0 00000100:00100000:2.0:1789579016.564464:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277173248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579016.564543:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579016.565316:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277173248 00000100:00100000:0.0:1789579016.565324:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277173248 00000100:00100000:0.0:1789579016.565697:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789579016.565709:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277173248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579016.565734:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579016.565793:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277173248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.565799:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789579016.574194:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277173248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579016.674815:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.676913:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398528 00000100:00100000:0.0:1789579016.676925:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398528 00000100:00100000:0.0:1789579016.677064:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:0.0:1789579016.677074:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+56:12429:x1876509261398528:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:0.0:1789579016.677266:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677283:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677295:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677306:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677314:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677320:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677410:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677419:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677427:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579016.677472:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677484:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677499:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677506:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677512:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.677516:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677523:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677534:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579016.677537:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579016.677542:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677548:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21bc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677561:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677567:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677573:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677578:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.677586:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677592:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677600:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:0.0:1789579016.677602:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579016.677605:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677611:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677637:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677643:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677649:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677654:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.677657:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677663:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677670:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579016.677672:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579016.677681:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.677688:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579016.677772:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+56:12429:x1876509261398528:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 698us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.677789:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 219 00000100:00100000:2.0:1789579016.779640:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.785429:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398784 00000100:00100000:0.0:1789579016.785443:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398784 00000100:00100000:0.0:1789579016.785511:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:0.0:1789579016.785521:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+56:12432:x1876509261398784:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579016.785539:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579016.785558:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec216 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785635:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785658:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785672:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785682:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785689:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785714:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785811:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21bec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785820:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785837:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579016.785848:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789579016.785916:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785924:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785930:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785937:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.785941:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785948:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785959:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579016.785962:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579016.785973:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785980:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21bde lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785993:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.785999:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786005:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786010:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579016.786013:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786018:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786026:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:0.0:1789579016.786028:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579016.786030:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786036:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21be5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786066:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21bd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec216 expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786089:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec216 expref: 58 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.786097:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579016.786099:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579016.786101:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789579016.786595:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+58:12432:x1876509261398784:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1073us (6960us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789579016.786602:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 220 00000100:00100000:3.0:1789579016.790278:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579016.790575:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261398912 00000100:00100000:2.0:1789579016.790585:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261398912 00000100:00100000:2.0:1789579016.790643:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00100000:2.0:1789579016.790659:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+58:12432:x1876509261398912:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:2.0:1789579016.790718:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790734:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790744:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790774:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790781:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790788:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790806:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579016.790810:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790818:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790839:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579016.790843:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579016.790847:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579016.790854:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21bfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579016.790919:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+58:12432:x1876509261398912:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 268us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579016.790926:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 221 00000100:00100000:3.0:1789579016.793649:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579016.793776:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261399168 00000100:00100000:1.0:1789579016.793783:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261399168 00000100:00100000:1.0:1789579016.793836:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789579016.793845:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+58:12432:x1876509261399168:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789579016.794027:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+59:12432:x1876509261399168:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 182us (384us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789579016.794044:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789579016.936725:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.936815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261399424 00000100:00100000:0.0:1789579016.936833:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261399424 00000100:00100000:0.0:1789579016.936890:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 222 00000100:00100000:0.0:1789579016.936900:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+59:12442:x1876509261399424:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579016.936923:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579016.936926:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789579016.936951:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367400/0xd90373d592f21b7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1fa expref: 59 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.936980:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579016.936985:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789579016.936999:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c01 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec21d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.937118:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.937141:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.937151:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579016.937162:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789579016.937254:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec21d expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.937267:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec21d expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.937275:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579016.937277:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579016.937280:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436a00, rc 0) 00000100:00100000:0.0:1789579016.937337:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+60:12442:x1876509261399424:12345-192.168.203.37@tcp:101:bash.0 Request processed in 438us (624us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789579016.937344:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 222 00000100:00100000:2.0:1789579016.940765:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.940849:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261399552 00000100:00100000:3.0:1789579016.940858:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261399552 00000100:00100000:3.0:1789579016.940904:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 223 00000100:00100000:3.0:1789579016.940913:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+60:12442:x1876509261399552:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579016.940935:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579016.940951:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec224 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.940983:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.940995:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.941006:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.941109:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 62 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.941134:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 61 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.941157:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579016.941160:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789579016.941164:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36800, rc 0) 00000100:00100000:3.0:1789579016.941212:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+61:12442:x1876509261399552:12345-192.168.203.37@tcp:101:bash.0 Request processed in 301us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579016.941219:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 223 00000100:00100000:3.0:1789579016.944836:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.944913:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261399680 00000100:00100000:0.0:1789579016.944921:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261399680 00000100:00100000:0.0:1789579016.944976:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579016.944985:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+61:2393:x1876509261399680:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579016.944999:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579016.945020:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec21d expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.945052:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579016.945057:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579016.945105:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+60:2393:x1876509261399680:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.945116:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:1.0:1789579016.952271:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579016.952494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261399936 00000100:00100000:3.0:1789579016.952503:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261399936 00000100:00100000:3.0:1789579016.952558:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 224 00000100:00100000:3.0:1789579016.952567:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+60:12442:x1876509261399936:12345-192.168.203.37@tcp:36:bash.0 00010000:00010000:3.0:1789579016.952621:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579016.952646:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f21bec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec216 expref: 60 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.952665:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579016.952670:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579016.952821:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.952850:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.952860:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579016.952911:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789579016.952930:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076e519cf reply state 000000008320cd1f transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.952942:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579016.952948:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579016.952951:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579016.952953:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789579016.953036:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+62:12442:x1876509261399936:12345-192.168.203.37@tcp:36:bash.0 Request processed in 470us (772us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789579016.953043:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 224 00000020:00080000:3.0:1789579016.953047:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789579016.955320:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579016.955441:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400064 00000100:00100000:0.0:1789579016.955449:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400064 00000100:00100000:0.0:1789579016.955487:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 225 00000100:00100000:0.0:1789579016.955495:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+62:12442:x1876509261400064:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579016.955512:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579016.955527:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec22b expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955594:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955606:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955628:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579016.955652:0:13782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789579016.955656:0:13782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579016.955671:0:13782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955692:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 64 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955723:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 63 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579016.955731:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579016.955734:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579016.955737:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579016.955785:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+63:12442:x1876509261400064:12345-192.168.203.37@tcp:101:bash.0 Request processed in 291us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579016.955792:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 225 00000100:00100000:2.0:1789579016.960622:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579016.960702:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400320 00000100:00100000:1.0:1789579016.960712:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400320 00000100:00100000:1.0:1789579016.960764:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:1.0:1789579016.960775:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+63:12442:x1876509261400320:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:1.0:1789579016.960965:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+64:12442:x1876509261400320:12345-192.168.203.37@tcp:35:bash.0 Request processed in 191us (361us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789579016.960973:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:1.0:1789579017.158457:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.158588:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400448 00000100:00100000:2.0:1789579017.158602:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400448 00000100:00100000:2.0:1789579017.158698:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:2.0:1789579017.158711:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+64:12448:x1876509261400448:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579017.158747:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579017.158774:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21c39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec232 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.158892:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.158910:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.158926:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579017.158987:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789579017.158991:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579017.159014:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.159043:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21c39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec232 expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.159066:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec232 expref: 65 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.159075:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579017.159079:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579017.159083:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00080000:0.0:1789579017.159712:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579017.159975:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261400448:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1262us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.159986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 226 00000100:00100000:2.0:1789579017.177273:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.177389:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400576 00000100:00100000:0.0:1789579017.177403:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400576 00000100:00100000:0.0:1789579017.177488:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:0.0:1789579017.177501:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261400576:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579017.177528:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579017.177564:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec239 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177660:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177678:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177693:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177758:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177764:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177769:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177846:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177853:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177861:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579017.177917:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789579017.177923:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579017.177947:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177960:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177970:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.177977:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178009:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178015:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579017.178020:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178028:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178042:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579017.178046:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579017.178051:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178059:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436200/0xd90373d592f21c4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178075:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178081:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178087:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178092:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579017.178095:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178113:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178122:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:0.0:1789579017.178125:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579017.178128:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178133:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178174:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21c47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec239 expref: 67 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178189:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec239 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.178197:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579017.178199:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579017.178202:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789579017.178285:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939402aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+66:12448:x1876509261400576:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 787us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.178294:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 227 00000100:00100000:0.0:1789579017.186595:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.186685:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.186937:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400704 00000100:00100000:2.0:1789579017.186967:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400704 00000100:00100000:2.0:1789579017.187051:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789579017.187061:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+66:2395:x1876509261400704:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579017.187087:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579017.187118:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec239 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.187154:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.187161:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579017.187229:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+65:2395:x1876509261400704:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 169us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.187237:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:3.0:1789579017.188848:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261400960 00000100:00100000:3.0:1789579017.188917:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261400960 00000100:00100000:3.0:1789579017.188992:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:3.0:1789579017.189001:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261400960:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579017.189034:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579017.189061:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec240 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.189450:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.189467:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 66 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.189557:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.189598:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 66 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.189626:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 66 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.189642:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277173376:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579017.189919:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.193742:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.193922:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277173376:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579017.193960:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.194557:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401088 00000100:00100000:2.0:1789579017.194568:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401088 00010000:00010000:2.0:1789579017.194625:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 67 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.194672:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 98 00000100:00100000:2.0:1789579017.194683:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+67:2394:x1876509261401088:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579017.194707:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579017.194715:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 67 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194730:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 67 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194757:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21c32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec22b expref: 67 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194793:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.194799:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194811:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194821:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.194850:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579017.194918:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+66:2394:x1876509261401088:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 236us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.194926:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 98 00010000:00010000:3.0:1789579017.196804:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.196826:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579017.196866:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789579017.197049:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 67 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.197078:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 66 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.197108:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579017.197116:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789579017.197120:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6600, rc 0) 00000100:00100000:3.0:1789579017.198266:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+66:12448:x1876509261400960:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 9254us (11673us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789579017.198278:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 228 00000100:00100000:0.0:1789579017.204075:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.204133:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401344 00000100:00100000:3.0:1789579017.204147:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401344 00000100:00100000:3.0:1789579017.204222:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789579017.204234:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+66:12448:x1876509261401344:12345-192.168.203.37@tcp:103:lfs.0 00010000:00010000:3.0:1789579017.204253:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579017.204283:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec20f expref: 66 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.204309:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579017.204315:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579017.204441:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261401344:12345-192.168.203.37@tcp:103:lfs.0 Request processed in 209us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.204450:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579017.206817:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.206931:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401472 00000100:00100000:3.0:1789579017.206943:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401472 00000100:00100000:3.0:1789579017.207013:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:3.0:1789579017.207023:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261401472:12345-192.168.203.37@tcp:58:lfs.0 00010000:00010000:3.0:1789579017.207182:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.207213:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.207227:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579017.207344:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789579017.207558:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261401472:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 535us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.207567:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 229 00000100:00100000:2.0:1789579017.212901:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.213323:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401600 00000100:00100000:0.0:1789579017.213407:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401600 00000100:00100000:0.0:1789579017.213489:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 230 00000100:00100000:0.0:1789579017.213500:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+65:12448:x1876509261401600:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579017.213524:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579017.213548:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec247 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213625:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213637:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 66 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213657:0:13782:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213671:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 66 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213685:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579017.213688:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579017.213692:0:13782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 66 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.213699:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436c00, rc 0) 00000100:00100000:0.0:1789579017.213764:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+66:12448:x1876509261401600:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 266us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.213771:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 230 00000001:00080000:0.0:1789579017.255754:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:0.0:1789579017.255797:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:1.0:1789579017.255834:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255850:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255859:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255865:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579017.255871:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255879:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255897:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93940905ba00) 00010000:00010000:1.0:1789579017.255914:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579017.255920:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255926:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21a09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255962:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255968:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.255974:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.256018:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579017.256043:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277173504:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789579017.256087:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579017.256093:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256100:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256109:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579017.256112:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579017.256115:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256122:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ab1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.256130:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579017.256143:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256159:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256165:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256170:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579017.256173:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256179:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256187:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:1.0:1789579017.256189:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579017.256192:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256209:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21b2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.256226:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277173504 00010000:00010000:1.0:1789579017.256227:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.256234:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277173504 00010000:00010000:1.0:1789579017.256235:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256243:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256248:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579017.256256:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256262:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256271:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07100) 00010000:00010000:1.0:1789579017.256274:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579017.256277:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256283:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367a00/0xd90373d592f21b52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.256284:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789579017.256295:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277173504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789579017.256304:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256321:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789579017.256324:0:10029:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789579017.256334:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256341:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579017.256343:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579017.256381:0:10029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aaacf07, atime: 0x6aaacf07, ctime: 0x6aaacf07, blocks: 0x8 00010000:00010000:1.0:1789579017.256383:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256388:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256393:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:1.0:1789579017.256399:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.256408:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789579017.256410:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256413:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579017.256423:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.256423:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21c24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256641:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256651:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256658:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.256726:0:10029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1789579017.256739:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939302359c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789579017.256743:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93943b5fe200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939302359540 00000020:00080000:0.0:1789579017.256747:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93943b5fea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93930378bc00 00000004:00080000:0.0:1789579017.256776:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789579017.256804:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93942ef58840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789579017.256807:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93941a91d800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93942ef58d80 00000020:00080000:0.0:1789579017.256809:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93941a91d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939304361200 00000020:00080000:0.0:1789579017.256830:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789579017.256868:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789579017.256912:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1876509277173504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 617us (784us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789579017.256920:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000004:00080000:3.0:1789579017.256973:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939304336300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789579017.256979:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277173504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789579017.257004:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277173632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789579017.257024:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579017.257033:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.257041:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579017.257043:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579017.257046:0:9493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.257056:0:9493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.257072:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.257087:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d48ea08/0xd90373d592f21c86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.257106:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579017.257109:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579017.257110:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579017.257145:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277173632 00000100:00100000:0.0:1789579017.257152:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277173632 00000100:00100000:0.0:1789579017.257190:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789579017.257198:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277173632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789579017.257216:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1789579017.257235:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.257658:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.257669:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789579017.257673:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579017.257678:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.257716:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 8 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.257729:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 8 pid: 8405 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.257739:0:8403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876509277173760:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579017.257811:0:8403:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.260998:0:8403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1876509277173760:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579017.261039:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.261640:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.261721:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401728 00000100:00100000:0.0:1789579017.261731:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401728 00000100:00080000:2.0:1789579017.261795:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789579017.261797:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 9 pid: 8405 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.261939:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 99 00000100:00100000:0.0:1789579017.261951:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+9:2394:x1876509261401728:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579017.261970:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579017.261977:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 9 pid: 8405 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.262017:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 9 pid: 8405 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.262050:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001857386f/0xd90373d592f21abf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1d0 expref: 9 pid: 8405 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.262072:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579017.262077:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579017.262083:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.262094:0:9492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.262128:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579017.262189:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261401728:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 240us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.262197:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 99 00010000:00010000:1.0:1789579017.262248:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.262258:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.262270:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.262279:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.262303:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579017.262562:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579017.262572:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.262582:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579017.262590:0:10313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.262601:0:10313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.262631:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.262640:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2ff2b2/0xd90373d592f21c8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.262647:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277173632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5447us (5602us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789579017.262657:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1789579017.262672:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579017.262675:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579017.262687:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789579017.262712:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939303bd7800/2, rc 0, transno 4294967320 00000100:00100000:1.0:1789579017.262722:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277173632:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789579017.264944:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1789579017.264963:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00010000:00010000:3.0:1789579017.379864:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789579017.509661:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789579017.509673:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789579017.509929:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789579017.509958:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789579017.510693:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277173888:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789579017.511115:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789579017.529840:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.530219:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401856 00000100:00100000:2.0:1789579017.530231:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401856 00000100:00100000:2.0:1789579017.530323:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 231 00000100:00100000:2.0:1789579017.530334:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940661b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261401856:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789579017.530413:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789579017.530576:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277173888:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789579017.530953:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940661b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+19:12449:x1876509261401856:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 619us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.530962:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 231 00000100:00100000:2.0:1789579017.548996:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.549558:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261401984 00000100:00100000:3.0:1789579017.549572:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261401984 00000100:00100000:3.0:1789579017.549849:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 232 00000100:00100000:3.0:1789579017.549870:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+19:12449:x1876509261401984:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789579017.549976:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.549996:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550107:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550128:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550246:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550256:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550286:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550296:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550303:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579017.550713:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789579017.550718:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579017.550735:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550749:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550756:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550763:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550770:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.550775:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550783:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550796:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:3.0:1789579017.550800:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.550805:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550811:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6000/0xd90373d592f21c94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550833:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.550848:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551063:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551070:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.551073:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551080:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551089:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff939405f07800) 00010000:00010000:3.0:1789579017.551092:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.551095:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551102:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7400/0xd90373d592f21c9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551120:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551127:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551132:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551574:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.551585:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551593:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551603:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579017.551606:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.551619:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.551625:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21ca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.551807:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+19:12449:x1876509261401984:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 1935us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.551817:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 232 00000100:00100000:0.0:1789579017.562576:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.563278:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261402240 00000100:00100000:2.0:1789579017.563297:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261402240 00000100:00100000:2.0:1789579017.563437:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 233 00000100:00100000:2.0:1789579017.563449:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+19:12449:x1876509261402240:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579017.563627:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579017.563655:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21ca9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec24e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.563795:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.563813:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.563829:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579017.563842:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789579017.565376:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.565412:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.565421:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.565427:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.565433:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.565441:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.565460:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.565463:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789579017.566097:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.566109:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.566603:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21ca9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec24e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.566628:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:2.0:1789579017.566631:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579017.566636:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21ca9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec24e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.566648:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af400, rc 0) 00000100:00100000:2.0:1789579017.566771:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261402240:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 3322us (4207us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789579017.566781:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 233 00000100:00100000:2.0:1789579017.573133:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277174016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579017.573245:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579017.573379:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277174016 00000100:00100000:0.0:1789579017.573389:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277174016 00000100:00100000:0.0:1789579017.573439:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789579017.573449:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277174016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579017.573517:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789579017.573573:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277174016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.573580:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789579017.573641:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277174016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579017.574732:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579017.574752:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277174144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579017.574805:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579017.574904:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277174144 00000100:00100000:0.0:1789579017.574911:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277174144 00000100:00100000:0.0:1789579017.574956:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789579017.574965:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277174144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579017.574997:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789579017.575055:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277174144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.575063:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789579017.575280:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277174144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579017.584250:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.584503:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261402368 00000100:00100000:3.0:1789579017.584517:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261402368 00000100:00100000:3.0:1789579017.584587:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 234 00000100:00100000:3.0:1789579017.584598:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261402368:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789579017.584656:0:9792:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789579017.584797:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261402368:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 201us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.584806:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 234 00000100:00100000:3.0:1789579017.594964:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.595409:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261402624 00000100:00100000:2.0:1789579017.595423:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261402624 00000100:00100000:2.0:1789579017.595501:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 235 00000100:00100000:2.0:1789579017.595513:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261402624:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579017.595538:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579017.595542:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789579017.595574:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21c40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec232 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.595599:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:2.0:1789579017.595605:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579017.595632:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec255 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789579017.597885:0:6490:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789579017.598122:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21cc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.599455:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.599588:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.599712:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec255 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.599739:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec255 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.599750:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9394091b5800) 00010000:00010000:2.0:1789579017.599753:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579017.599756:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579017.600726:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261402624:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 4341us (4900us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789579017.600739:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 235 00000100:00100000:2.0:1789579017.613832:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.616865:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261402880 00000100:00100000:3.0:1789579017.616888:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261402880 00000100:00100000:3.0:1789579017.617004:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 236 00000100:00100000:3.0:1789579017.617018:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261402880:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789579017.617116:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579017.617152:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21cc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec255 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617178:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9394091b5800) 00010000:00010000:3.0:1789579017.617205:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579017.617232:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617254:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617265:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617553:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617575:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617588:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617648:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617656:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617663:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617748:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.617754:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617762:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617943:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579017.617947:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.617953:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617960:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21cd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617979:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617985:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617992:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.617998:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.618000:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.618007:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.618030:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x32d512cc (ffff939405f07800) 00010000:00010000:3.0:1789579017.618033:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.618037:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.618043:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21cda lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x32d512cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.618300:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261402880:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1279us (4475us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789579017.618317:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 236 00000100:00100000:3.0:1789579017.623595:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.627996:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261403008 00000100:00100000:0.0:1789579017.628026:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261403008 00000100:00100000:0.0:1789579017.628194:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:0.0:1789579017.628207:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+20:12449:x1876509261403008:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579017.628232:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579017.628264:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ce1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec25c expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.628305:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.629051:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.629067:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.629206:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437e00/0xd90373d592f21ce1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.629230:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 21 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.629239:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:0.0:1789579017.629243:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789579017.629247:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789579017.629343:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261403008:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1138us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.630147:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 237 00000100:00100000:3.0:1789579017.634708:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.634970:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261403264 00000100:00100000:1.0:1789579017.634998:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261403264 00000100:00100000:1.0:1789579017.635079:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00100000:1.0:1789579017.635090:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261403264:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789579017.635200:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.635220:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.635234:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789579017.635632:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789579017.635646:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372768294304ns, next at 373768290384ns, rc = 0 00000004:00010000:1.0:1789579017.635703:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab3ea636 reply state 00000000144bda75 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.635717:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.635726:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:1.0:1789579017.635730:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789579017.635735:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789579017.635847:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+23:12449:x1876509261403264:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 757us (1151us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789579017.638736:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 238 00000100:00100000:1.0:1789579017.644694:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.650595:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261403392 00000100:00100000:2.0:1789579017.650627:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261403392 00000100:00100000:2.0:1789579017.650779:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00100000:2.0:1789579017.650792:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+23:12449:x1876509261403392:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579017.650821:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579017.650847:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec263 expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.650943:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 24 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.650961:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 24 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.650983:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:2.0:1789579017.650986:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579017.650991:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789579017.651076:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+24:12449:x1876509261403392:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 287us (6396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.651084:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 239 00000100:00100000:3.0:1789579017.660278:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.660436:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261403520 00000100:00100000:2.0:1789579017.660459:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261403520 00000100:00100000:2.0:1789579017.660522:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:2.0:1789579017.660534:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+6:2395:x1876509261403520:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789579017.661064:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261403520:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 528us (795us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789579017.661074:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:3.0:1789579017.665762:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.666366:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261403776 00000100:00100000:1.0:1789579017.666381:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261403776 00000100:00100000:1.0:1789579017.666453:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:1.0:1789579017.666485:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+24:12449:x1876509261403776:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789579017.666793:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+25:12449:x1876509261403776:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 310us (1042us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789579017.666801:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:1.0:1789579017.669717:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.670536:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404032 00000100:00100000:0.0:1789579017.670550:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404032 00000100:00100000:1.0:1789579017.670701:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 240 00000100:00100000:1.0:1789579017.670722:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+25:12449:x1876509261404032:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789579017.670883:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+25:12449:x1876509261404032:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 166us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.670891:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 240 00000100:00100000:0.0:1789579017.675782:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.676254:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404160 00000100:00100000:1.0:1789579017.676267:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404160 00000100:00100000:0.0:1789579017.676549:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 241 00000100:00100000:0.0:1789579017.676564:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+25:12449:x1876509261404160:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579017.676590:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579017.676627:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21cfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec26a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676747:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676765:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676780:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579017.676837:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579017.676870:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676902:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21cfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec26a expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676923:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec26a expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.676933:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:0.0:1789579017.676936:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789579017.676941:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789579017.677078:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+26:12449:x1876509261404160:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 518us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.677086:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 241 00000100:00100000:2.0:1789579017.686144:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.686251:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404288 00000100:00100000:1.0:1789579017.686264:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404288 00000100:00100000:1.0:1789579017.686336:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:1.0:1789579017.686347:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261404288:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579017.686388:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579017.686417:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec271 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789579017.686452:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaacf08, blocks: 0x0 00010000:00010000:1.0:1789579017.686477:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789579017.686483:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579017.686493:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.686537:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.686551:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366000, rc 0) 00000100:00100000:1.0:1789579017.686639:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261404288:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 293us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.686646:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:2.0:1789579017.693462:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.695565:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404544 00000100:00100000:3.0:1789579017.695584:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404544 00000100:00100000:3.0:1789579017.695676:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 242 00000100:00100000:3.0:1789579017.695688:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+26:12449:x1876509261404544:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789579017.695873:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+26:12449:x1876509261404544:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 186us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.695881:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 242 00000100:00100000:3.0:1789579017.699625:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.699808:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404672 00000100:00100000:0.0:1789579017.699820:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404672 00000100:00100000:0.0:1789579017.699895:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:0.0:1789579017.699923:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:12449:x1876509261404672:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579017.699947:0:10029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579017.699969:0:10029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec278 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.700009:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.700019:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579017.700024:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579017.700030:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.700068:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.700089:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.700105:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277174272:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579017.700230:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.703308:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277174272:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579017.703384:0:10029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.703435:0:10029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579017.703505:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+9:12449:x1876509261404672:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 3583us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.703515:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:1.0:1789579017.711584:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.711680:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404800 00000100:00100000:2.0:1789579017.711697:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404800 00010000:00010000:2.0:1789579017.711759:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.711842:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:2.0:1789579017.711861:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261404800:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579017.711883:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579017.711911:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.711927:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.711956:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000417648be/0xd90373d592f21d0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec271 expref: 9 pid: 8405 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.711978:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579017.711982:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579017.711992:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.712004:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.712057:0:6476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.712075:0:6476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6476:1876509277174400:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789579017.713434:0:6476:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579017.718748:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.718778:0:6476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6476:1876509277174400:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789579017.718809:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579017.718884:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261404800:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 7031us (7395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.718896:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:1.0:1789579017.720180:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261404928 00000100:00100000:1.0:1789579017.720193:0:8410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261404928 00002000:00100000:1.0:1789579017.720248:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff939304337b80 x1876509261404928/t0(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:263/0 lens 504/0 e 0 to 0 dl 1789579028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789579017.720266:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304337b80 with x1876509261404928 ext(0->12) 00002000:00010000:1.0:1789579017.720272:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939304337b80 00000100:00100000:1.0:1789579017.720309:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:1.0:1789579017.720319:0:8410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261404928:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789579017.726848:0:8410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28fc5077-c53d-437a-bade-84c159d25114+10:2395:x1876509261404928:12345-192.168.203.37@tcp:4:lhsmtool_posix.0 Request processed in 6510us (8096us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789579017.726875:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00002000:00100000:1.0:1789579017.727546:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff939304337b80 x1876509261404928/t4294967322(0) o4->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:263/0 lens 504/448 e 0 to 0 dl 1789579028 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789579017.727561:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff939304337b80 with x1876509261404928 ext(0->12) 00002000:00010000:1.0:1789579017.727592:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939304337b80 00000100:00100000:0.0:1789579017.734115:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.735324:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405056 00000100:00100000:1.0:1789579017.735340:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405056 00000100:00100000:1.0:1789579017.735459:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 243 00000100:00100000:1.0:1789579017.735470:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+26:12449:x1876509261405056:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789579017.742917:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789579017.742941:0:6469:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789579017.742971:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789579017.743124:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1789579017.743157:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789579017.743482:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579017.743508:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277174528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789579017.743597:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579017.743677:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277174528 00000100:00100000:1.0:1789579017.743687:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277174528 00000100:00100000:1.0:1789579017.743765:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789579017.743776:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277174528:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789579017.744382:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744399:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744408:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744416:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.744422:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744431:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744449:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:2.0:1789579017.744453:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789579017.744458:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.744466:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21cef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789579017.744599:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789579017.744604:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789579016 00002000:00010000:1.0:1789579017.744615:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789579017.744617:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789579016 -> 1789579016 00002000:00010000:1.0:1789579017.744621:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789579017.744704:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1876509277174528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 928us (1105us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789579017.744714:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789579017.746314:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261405056:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 10831us (12201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.746331:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 243 00000100:00100000:2.0:1789579017.755065:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.755682:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967320 gen 2 00000004:00080000:2.0:1789579017.755691:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967320 00000004:00080000:2.0:1789579017.755758:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939303bd7800, transno 4294967320 00000100:00100000:2.0:1789579017.755784:0:3617:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93930486c000 x1876509277174528/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789579033 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789579017.755799:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93930486c000/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789579017.755806:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277174528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789579017.760045:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405184 00000100:00100000:0.0:1789579017.760063:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405184 00000100:00100000:0.0:1789579017.760257:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789579017.760270:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+10:2393:x1876509261405184:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789579017.777206:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1789579017.777229:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1789579017.777520:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2393:x1876509261405184:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 17246us (22509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.777534:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 76 00000100:00100000:0.0:1789579017.783201:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.783280:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405440 00000100:00100000:1.0:1789579017.783293:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405440 00000100:00100000:1.0:1789579017.783400:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 244 00000100:00100000:1.0:1789579017.783411:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261405440:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789579017.783507:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579017.783539:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21d04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec26a expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.783563:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:1.0:1789579017.783569:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579017.783603:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.783630:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.783641:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579017.783806:0:6490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abb4ed20 reply state 000000002390d9ed transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.783819:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.783825:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:1.0:1789579017.783829:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789579017.783837:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789579017.783965:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+22:12449:x1876509261405440:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 555us (777us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789579017.783973:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 244 00000100:00100000:3.0:1789579017.803266:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.804320:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405568 00000100:00100000:1.0:1789579017.804336:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405568 00000100:00100000:1.0:1789579017.804457:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:1.0:1789579017.804484:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261405568:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789579017.804700:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789579017.804704:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789579016 -> 1789579016 00002000:00010000:1.0:1789579017.804707:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789579015 00002000:00010000:1.0:1789579017.804709:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789579016 -> 1789579016 00002000:00010000:1.0:1789579017.804711:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789579017.804805:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261405568:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 323us (1552us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789579017.804813:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 77 00000100:00100000:2.0:1789579017.809444:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.809577:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405824 00000100:00100000:3.0:1789579017.809590:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405824 00000100:00100000:3.0:1789579017.809671:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 245 00000100:00100000:3.0:1789579017.809699:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+22:12449:x1876509261405824:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789579017.809790:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.809811:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.809822:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.809874:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 22 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.809890:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 22 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.809906:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277174656:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579017.810030:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789579017.818743:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.818898:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277174656:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579017.818934:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.819330:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261405952 00000100:00100000:1.0:1789579017.819340:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261405952 00010000:00010000:0.0:1789579017.819816:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 23 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.819998:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:0.0:1789579017.820010:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+23:2394:x1876509261405952:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579017.820030:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579017.820038:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 23 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820074:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 23 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820101:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437000/0xd90373d592f21ce8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec25c expref: 23 pid: 13782 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820120:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:0.0:1789579017.820126:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820600:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820620:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.820753:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579017.820830:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+22:2394:x1876509261405952:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 821us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.820839:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00010000:00010000:3.0:1789579017.822713:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822734:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822786:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822794:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822821:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822828:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.822833:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822842:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822919:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:3.0:1789579017.822923:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789579017.822928:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.822936:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.823094:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261405824:12345-192.168.203.37@tcp:55:lhsmtool_posix.0 Request processed in 13393us (13656us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789579017.823106:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 245 00000100:00100000:0.0:1789579017.831658:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.831784:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406080 00000100:00100000:1.0:1789579017.831797:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406080 00000100:00100000:1.0:1789579017.831870:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789579017.831881:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261406080:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789579017.831941:0:10029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.831968:0:10029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.831978:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579017.831983:0:10029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789579017.831989:0:10029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.832030:0:10029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.832067:0:10029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 8 pid: 10029 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.832085:0:10029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277174784:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579017.832196:0:10029:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941031a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579017.844759:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579017.846020:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406208 00000100:00100000:0.0:1789579017.846036:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406208 00010000:00010000:0.0:1789579017.846101:0:9492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.846155:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 102 00000100:00100000:0.0:1789579017.846166:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+9:2395:x1876509261406208:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579017.846212:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579017.846242:0:9492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.846259:0:9492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.846290:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579017.846296:0:9492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579017.846303:0:9492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.846316:0:9492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.846342:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579017.846453:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec278 expref: 9 pid: 10029 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.846475:0:10029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10029:1876509277174784:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579017.846506:0:10029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.846535:0:10029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.846543:0:10029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.846569:0:10029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579017.846632:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261406208:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 466us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579017.846641:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 102 00010000:00010000:3.0:1789579017.847209:0:10029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.847226:0:10029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.847234:0:10029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579017.847239:0:10029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.847251:0:10029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.847267:0:10029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.847289:0:10029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f21d27 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.848885:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261406080:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 16992us (17228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.848899:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 78 00000100:00100000:1.0:1789579017.858112:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.858395:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406464 00000100:00100000:3.0:1789579017.858408:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406464 00000100:00100000:3.0:1789579017.858485:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 246 00000100:00100000:3.0:1789579017.858497:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+21:12449:x1876509261406464:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789579017.858594:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.858624:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.858636:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.858679:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.858695:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 21 pid: 9792 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.858711:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277174912:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579017.858829:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.864819:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.865412:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277174912:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579017.865446:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.865640:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406592 00000100:00100000:2.0:1789579017.865648:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406592 00010000:00010000:2.0:1789579017.865698:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 22 pid: 9792 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.866987:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 103 00000100:00100000:2.0:1789579017.867018:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+22:2394:x1876509261406592:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579017.867041:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579017.867052:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 22 pid: 9792 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867069:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 22 pid: 9792 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867119:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36800/0xd90373d592f21c1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec224 expref: 22 pid: 9792 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867153:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.867159:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 21 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867172:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867181:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867190:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.867225:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579017.867289:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28fc5077-c53d-437a-bade-84c159d25114+21:2394:x1876509261406592:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 290us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579017.867297:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 103 00010000:00010000:3.0:1789579017.868445:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.868460:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.870048:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.870079:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.870089:0:13782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.870147:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.870167:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 21 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.870199:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277175040:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579017.870310:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394089cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.877047:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.877144:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406720 00000100:00100000:1.0:1789579017.877156:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406720 00010000:00010000:1.0:1789579017.877205:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 22 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.877250:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:1.0:1789579017.877261:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+22:2395:x1876509261406720:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579017.877279:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579017.877287:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 22 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.877301:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 22 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.877330:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:1.0:1789579017.877337:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.877398:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.877407:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.877430:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579017.877492:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28fc5077-c53d-437a-bade-84c159d25114+22:2395:x1876509261406720:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 232us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.877500:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00010000:00010000:3.0:1789579017.878076:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21cf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec263 expref: 21 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.878108:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277175040:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579017.878148:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.878159:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.878166:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579017.878303:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789579017.878458:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789579017.878492:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789579017.878576:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277175168:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789579017.878652:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579017.878693:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393029e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789579017.879978:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277175168 00000100:00100000:1.0:1789579017.879992:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277175168 00000100:00100000:1.0:1789579017.880062:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789579017.880073:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13782:x1876509277175168:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789579017.880223:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13782:x1876509277175168:12345-0@lo:1000:mdt00_004.0 Request processed in 152us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.880230:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789579017.880582:0:13782:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1789579017.880590:0:13782:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93930486c000, transno 4294967323 00000100:00100000:2.0:1789579017.880618:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277175168:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789579017.880796:0:13782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789579017.880877:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277175296:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789579017.880930:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579017.881287:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.889583:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277175296 00000100:00100000:0.0:1789579017.889616:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277175296 00000100:00100000:0.0:1789579017.889734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789579017.889747:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13782:x1876509277175296:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789579017.890008:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13782:x1876509277175296:12345-0@lo:1000:mdt00_004.0 Request processed in 264us (9077us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789579017.890032:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789579017.890578:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13782:1876509277175296:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789579017.890654:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890666:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890676:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890683:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.890688:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890698:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890717:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:2.0:1789579017.890721:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579017.890727:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890735:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890769:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890776:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890782:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890796:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.890799:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890805:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890814:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.890816:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579017.890825:0:13782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890838:0:13782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890848:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.890886:0:13782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.890902:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277175424:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789579017.891002:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407830300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579017.896702:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.898400:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261406848 00000100:00100000:1.0:1789579017.898417:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261406848 00000100:00100000:1.0:1789579017.898510:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:1.0:1789579017.898521:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+25:12448:x1876509261406848:12345-192.168.203.37@tcp:49:lfs.0 00000100:00100000:1.0:1789579017.898706:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+25:12448:x1876509261406848:12345-192.168.203.37@tcp:49:lfs.0 Request processed in 186us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.898716:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789579017.899480:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13782:1876509277175424:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789579017.899519:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899554:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6a00/0xd90373d592f21c78 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899598:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899629:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899643:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899655:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899661:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899669:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899675:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.899680:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899687:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899699:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.899703:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579017.899706:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899722:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f21d3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899733:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899740:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899746:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899751:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579017.899755:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899762:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899770:0:13782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579017.899772:0:13782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579017.899776:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.899782:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.902106:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+24:12449:x1876509261406464:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 43593us (43990us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789579017.902123:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 246 00000020:00080000:2.0:1789579017.902147:0:13782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789579017.904298:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789579017.904310:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579017.904975:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789579017.904988:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789579017.910941:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.911035:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261407104 00000100:00100000:3.0:1789579017.911048:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261407104 00000100:00100000:3.0:1789579017.911117:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 247 00000100:00100000:3.0:1789579017.911128:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+24:12448:x1876509261407104:12345-192.168.203.37@tcp:58:lfs.0 00000040:00080000:3.0:1789579017.911688:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789579017.911799:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+24:12448:x1876509261407104:12345-192.168.203.37@tcp:58:lfs.0 Request processed in 671us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.911809:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 247 00000100:00100000:1.0:1789579017.916296:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.916796:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261407360 00000100:00100000:2.0:1789579017.916810:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261407360 00000100:00100000:2.0:1789579017.917238:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:2.0:1789579017.917252:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b601050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+24:12449:x1876509261407360:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789579017.917664:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789579017.917822:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789579017.917884:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917903:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917917:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917928:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917935:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917942:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579017.917966:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789579017.918105:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b601050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+26:12449:x1876509261407360:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 855us (1824us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789579017.918114:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000020:00080000:2.0:1789579017.918120:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789579017.918160:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579017.918170:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.918180:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579017.918185:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.918195:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.918211:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:0.0:1789579017.918216:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789579017.918222:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.918229:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af000/0xd90373d592f21d43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579017.918244:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579017.918247:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579017.918249:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579017.950146:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579017.950892:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261407488 00000100:00100000:3.0:1789579017.950908:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261407488 00000100:00100000:3.0:1789579017.950997:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 248 00000100:00100000:3.0:1789579017.951020:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+26:12451:x1876509261407488:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579017.951055:0:9792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579017.951083:0:9792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec27f expref: -99 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951166:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951185:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951201:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951219:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951226:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951232:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951348:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951397:0:9792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 27 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951406:0:9792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951457:0:9792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 27 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.951786:0:9792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 27 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579017.951805:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277175552:192.168.203.37@tcp:104: 00000100:00100000:3.0:1789579017.952059:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406610cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579017.958541:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579017.958996:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261407744 00000100:00100000:2.0:1789579017.959018:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261407744 00000100:00100000:2.0:1789579017.959084:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:2.0:1789579017.959095:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+28:6163:x1876509261407744:12345-192.168.203.37@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789579017.959667:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+29:6163:x1876509261407744:12345-192.168.203.37@tcp:35:ldlm_bl.0 Request processed in 572us (1136us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789579017.959677:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:3.0:1789579017.963011:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9792:1876509277175552:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579017.963051:0:9792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579017.965144:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579017.965730:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261407872 00000100:00100000:1.0:1789579017.965762:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261407872 00010000:00010000:1.0:1789579017.965812:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 29 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579017.965869:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:1.0:1789579017.965880:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+29:2394:x1876509261407872:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579017.965898:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579017.965906:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 29 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.965921:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 29 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.965948:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c6600/0xd90373d592f21c6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec240 expref: 29 pid: 9792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.965973:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:1.0:1789579017.965979:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.965990:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.965999:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579017.966045:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579017.966115:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28fc5077-c53d-437a-bade-84c159d25114+28:2394:x1876509261407872:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 236us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579017.966131:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 105 00010000:00010000:3.0:1789579017.967833:0:9792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.967853:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579017.967920:0:9792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789579017.967925:0:9792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579017.967949:0:9792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.967966:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.967978:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968014:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968022:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968029:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.968034:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968043:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968058:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:3.0:1789579017.968062:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.968067:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968073:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37a00/0xd90373d592f21d51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968090:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968097:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968104:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968108:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579017.968116:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968123:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968130:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939405f07800) 00010000:00010000:3.0:1789579017.968487:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579017.968492:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968500:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968551:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec27f expref: 28 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968567:0:9792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec27f expref: 27 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579017.968575:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579017.968578:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579017.968581:0:9792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a36e00, rc 0) 00000100:00100000:3.0:1789579017.968661:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+27:12451:x1876509261407488:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 17644us (18530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579017.968671:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 248 00010000:00010000:3.0:1789579018.404043:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789579018.922920:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789579018.922933:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789579018.922965:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789579018.922997:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789579018.923238:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277175680:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789579018.923389:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303bec780 going to sleep for 11 seconds 00000100:00100000:3.0:1789579018.945431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579018.945606:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13770:1876509277175680:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789579018.945756:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261408000 00000100:00100000:2.0:1789579018.945765:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261408000 00000100:00100000:2.0:1789579018.945831:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 249 00000100:00100000:2.0:1789579018.945853:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+27:12462:x1876509261408000:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789579018.945903:0:13782:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789579018.946050:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:28fc5077-c53d-437a-bade-84c159d25114+27:12462:x1876509261408000:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 208us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579018.946057:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 249 00000100:00100000:2.0:1789579018.952747:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579018.952804:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261408256 00000100:00100000:2.0:1789579018.952817:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261408256 00000100:00100000:2.0:1789579018.952887:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00100000:2.0:1789579018.952898:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+27:12462:x1876509261408256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579018.952925:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579018.952949:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21d66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec286 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579018.953098:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21d6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579018.953114:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579018.953131:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579018.953144:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789579018.953296:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f21d66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec286 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579018.953317:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec286 expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579018.953327:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:2.0:1789579018.953330:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579018.953334:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579018.953425:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+29:12462:x1876509261408256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 528us (691us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789579018.953433:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 250 00000100:00100000:3.0:1789579018.965013:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579018.982726:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579018.982779:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261408640 00000100:00100000:3.0:1789579018.982792:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261408640 00000100:00100000:3.0:1789579018.982884:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:3.0:1789579018.982896:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+29:2394:x1876509261408640:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579018.982916:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579018.982947:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f21d6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec286 expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579018.982984:0:13705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579018.982992:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579018.983058:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28fc5077-c53d-437a-bade-84c159d25114+28:2394:x1876509261408640:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 164us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579018.983067:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:0.0:1789579018.983979:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261408512 00000100:00100000:0.0:1789579018.983995:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261408512 00000100:00100000:0.0:1789579018.984049:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 251 00000100:00100000:0.0:1789579018.984058:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+28:12462:x1876509261408512:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789579018.984148:0:9792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.984167:0:9792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.984191:0:9792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.986776:0:9792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.986798:0:9792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.986806:0:9792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.986813:0:9792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579018.986818:0:9792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.986827:0:9792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.987444:0:9792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579018.987450:0:9792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789579018.990556:0:9792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579018.990592:0:9792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f21d7b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579018.990843:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+29:12462:x1876509261408512:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 6779us (25837us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789579018.990855:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 251 00000040:00080000:1.0:1789579018.992583:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579018.992594:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579018.993213:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789579018.993226:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789579018.994860:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579018.994914:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261408896 00000100:00100000:0.0:1789579018.994926:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261408896 00000100:00100000:0.0:1789579018.994985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:0.0:1789579018.994997:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+29:12462:x1876509261408896:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789579018.995272:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+30:12462:x1876509261408896:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 276us (428us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789579018.995281:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000040:00080000:0.0:1789579019.246390:0:14734:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789579019.246403:0:14734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579019.246439:0:14734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789579019.246447:0:14734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789579019.428757:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579019.572051:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579019.579127:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409152 00000100:00100000:2.0:1789579019.579146:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409152 00000100:00100000:3.0:1789579019.579870:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 252 00000100:00100000:3.0:1789579019.579887:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+30:12475:x1876509261409152:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579019.579920:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579019.579955:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec28d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579019.580100:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579019.580146:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579019.580160:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579019.580175:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789579019.580338:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36c00/0xd90373d592f21d82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec28d expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579019.580391:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec28d expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579019.580401:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:3.0:1789579019.580405:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789579019.580409:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303a37400, rc 0) 00000100:00100000:3.0:1789579019.582132:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+32:12475:x1876509261409152:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 2233us (10080us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789579019.582148:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 252 00000100:00080000:2.0:1789579019.587173:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579019.591540:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579019.591857:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409280 00000100:00100000:1.0:1789579019.591871:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409280 00000100:00100000:1.0:1789579019.591939:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 253 00000100:00100000:1.0:1789579019.591951:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+32:12475:x1876509261409280:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:1.0:1789579019.592042:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592062:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592075:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592120:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592128:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592136:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592142:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579019.592147:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592170:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592198:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:1.0:1789579019.592201:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789579019.592208:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579019.592215:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367000/0xd90373d592f21d97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579019.592299:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+32:12475:x1876509261409280:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 350us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579019.592306:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 253 00000100:00100000:3.0:1789579019.748556:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579019.748638:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409408 00000100:00100000:0.0:1789579019.748652:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409408 00000100:00100000:0.0:1789579019.748752:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00100000:0.0:1789579019.748764:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2394:x1876509261409408:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:0.0:1789579019.748787:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579019.748812:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec294 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789579019.748861:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aaacf08, atime: 0x6aaacf07, ctime: 0x6aaacf08, blocks: 0x8 00010000:00010000:0.0:1789579019.748889:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1789579019.748894:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579019.748905:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec294 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579019.748925:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec294 expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579019.748952:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579019.749026:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+8:2394:x1876509261409408:12345-192.168.203.37@tcp:101:cat.0 Request processed in 264us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579019.749033:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 79 00000100:00080000:2.0:1789579019.749277:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579019.753633:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579019.762763:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409536 00000100:00100000:0.0:1789579019.762783:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409536 00002000:00100000:0.0:1789579019.762857:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff93930486e680 x1876509261409536/t0(0) o3->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:265/0 lens 488/0 e 0 to 0 dl 1789579030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579019.762870:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93930486e680 with x1876509261409536 ext(0->4095) 00002000:00010000:0.0:1789579019.762878:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93930486e680 00000100:00100000:0.0:1789579019.762920:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:0.0:1789579019.762939:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261409536:12345-192.168.203.37@tcp:3:cat.0 00000100:00100000:0.0:1789579019.763500:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28fc5077-c53d-437a-bade-84c159d25114+8:2395:x1876509261409536:12345-192.168.203.37@tcp:3:cat.0 Request processed in 569us (9881us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789579019.763529:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00002000:00100000:0.0:1789579019.763536:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff93930486e680 x1876509261409536/t0(0) o3->28fc5077-c53d-437a-bade-84c159d25114@192.168.203.37@tcp:265/0 lens 488/4536 e 0 to 0 dl 1789579030 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789579019.763545:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93930486e680 with x1876509261409536 ext(0->4095) 00002000:00010000:0.0:1789579019.763549:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93930486e680 00000040:00080000:1.0:1789579020.003753:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579020.003766:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579020.003795:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789579020.003806:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789579020.393480:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789579020.451896:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579020.917538:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579020.917601:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579020.917627:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409664 00000100:00100000:2.0:1789579020.917640:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409664 00000100:00100000:0.0:1789579020.917640:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579020.917674:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409920 00000100:00100000:0.0:1789579020.917681:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579020.917690:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409920 00000100:00100000:0.0:1789579020.917718:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579020.917723:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 389 00000100:00100000:2.0:1789579020.917738:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261409664:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579020.917754:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579020.917783:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410432 00000100:00100000:3.0:1789579020.917788:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410432 00000100:00100000:0.0:1789579020.917795:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579020.917828:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261409792 00000100:00100000:3.0:1789579020.917834:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261409792 00000100:00100000:0.0:1789579020.917836:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410176 00000100:00100000:0.0:1789579020.917844:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410176 00000100:00100000:2.0:1789579020.917859:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261409664:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579020.917862:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410304 00000100:00100000:3.0:1789579020.917872:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410304 00000100:00100000:2.0:1789579020.917879:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 389 00000100:00100000:0.0:1789579020.917907:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410048 00000100:00100000:0.0:1789579020.917916:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410048 00000100:00100000:3.0:1789579020.917924:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 324 00000100:00100000:3.0:1789579020.917953:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261409920:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579020.917958:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 100 00000100:00100000:3.0:1789579020.918037:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261409920:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579020.918046:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 324 00000100:00100000:3.0:1789579020.918070:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 325 00000100:00100000:3.0:1789579020.918078:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261410432:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579020.918099:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 326 00000100:00100000:2.0:1789579020.918114:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+32:2392:x1876509261409792:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579020.918126:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261410432:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579020.918134:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 325 00000100:00100000:3.0:1789579020.918153:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 327 00000100:00100000:3.0:1789579020.918162:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261410304:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579020.918168:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+32:2392:x1876509261409792:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 58us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579020.918183:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 326 00000100:00100000:3.0:1789579020.918218:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261410304:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 55us (426us total) trans 0 rc 0/0 00000100:00080000:2.0:1789579020.918219:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789579020.918230:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579020.918238:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 327 00000100:00080000:2.0:1789579020.918238:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579020.918284:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:2.0:1789579020.918297:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2392:x1876509261410048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579020.918338:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28fc5077-c53d-437a-bade-84c159d25114+8:2392:x1876509261410048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 44us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579020.918345:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 101 00000100:00100000:0.0:1789579020.918656:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261410176:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579020.918706:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261410176:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 736us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579020.918713:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 100 00010000:00010000:3.0:1789579021.475608:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579021.667735:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277175808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579021.667814:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.667906:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277175808 00000100:00100000:0.0:1789579021.667919:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277175808 00000100:00100000:0.0:1789579021.667974:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789579021.667984:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277175808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579021.668011:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789579021.668055:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277175808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.668062:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789579021.668084:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579021.668129:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277175808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579021.673383:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277175936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579021.673445:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.685180:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277175936 00000100:00100000:0.0:1789579021.685195:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277175936 00000100:00100000:0.0:1789579021.685253:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789579021.685264:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277175936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579021.685288:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789579021.685379:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277175936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (11933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.685386:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1789579021.685425:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579021.685457:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277175936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579021.689675:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277176064:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.689749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.689792:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277176576:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.689897:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.689916:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277177088:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.689949:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.689973:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789579021.689979:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277176192:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.689999:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.690016:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277176704:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690017:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176576 00000100:00100000:0.0:1789579021.690024:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176576 00000100:00100000:2.0:1789579021.690033:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.690046:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277177216:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690066:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.690066:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789579021.690075:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277176576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690090:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176064 00000100:00100000:2.0:1789579021.690093:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176064 00000100:00100000:2.0:1789579021.690117:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789579021.690124:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277176064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690126:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277176576:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.690138:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789579021.690150:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277176064:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579021.690155:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789579021.690185:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177088 00000100:00100000:2.0:1789579021.690189:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177088 00000100:00100000:2.0:1789579021.690219:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176192 00000100:00100000:2.0:1789579021.690221:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176192 00000100:00100000:2.0:1789579021.690237:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176704 00000100:00100000:2.0:1789579021.690239:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176704 00000100:00100000:2.0:1789579021.690253:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789579021.690259:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277177088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690286:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277177088:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579021.690292:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789579021.690303:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789579021.690316:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277176192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690344:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277176192:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579021.690365:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789579021.690377:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789579021.690383:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277176704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690395:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277176192:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690406:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277176064:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690407:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277176704:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579021.690413:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789579021.690414:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277176576:0@lo:400:kworker.0 00010000:00080000:0.0:1789579021.690425:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304337800 x1876509277177088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579021.690434:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177216 00000100:00100000:0.0:1789579021.690434:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277177088:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690437:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177216 00000100:00100000:0.0:1789579021.690455:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277176704:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690460:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789579021.690466:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277177216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789579021.690476:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579021.690480:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789579021.690482:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579021.690491:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277176448:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690495:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277177216:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579021.690501:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789579021.690526:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579021.690539:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176448 00000100:00100000:2.0:1789579021.690543:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176448 00000100:00100000:2.0:1789579021.690562:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789579021.690568:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277176448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690574:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277177216:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690604:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277176448:12345-0@lo:400:kworker.0 Request processed in 37us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.690607:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277176448:0@lo:400:kworker.0 00000100:00100000:2.0:1789579021.690610:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789579021.690613:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277176960:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690634:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.690656:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579021.690676:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.690695:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789579021.690701:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277176320:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.690721:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.692084:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277176832:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692141:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.692162:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277177344:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692186:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579021.692218:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176320 00000100:00100000:0.0:1789579021.692223:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176320 00000100:00100000:0.0:1789579021.692256:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789579021.692263:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277176320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692304:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277176320:12345-0@lo:400:kworker.0 Request processed in 41us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.692310:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789579021.692329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176960 00000100:00100000:0.0:1789579021.692333:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176960 00000100:00100000:0.0:1789579021.692374:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277176832 00000100:00100000:0.0:1789579021.692378:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277176832 00000100:00100000:0.0:1789579021.692399:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789579021.692406:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277176960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692435:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277176960:12345-0@lo:400:kworker.0 Request processed in 30us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.692441:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789579021.692453:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789579021.692458:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277176832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692483:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277176832:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.692489:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789579021.692506:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177344 00000100:00100000:0.0:1789579021.692510:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177344 00000100:00100000:0.0:1789579021.692547:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789579021.692553:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277177344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.692596:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277177344:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.692603:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789579021.692631:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177472 00000100:00100000:0.0:1789579021.692635:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177472 00000100:00100000:0.0:1789579021.692656:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789579021.692661:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579021.692681:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579021.692708:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579021.692713:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1789579021.692729:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579021.692733:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789579021.692735:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579021.699252:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277176320:0@lo:400:kworker.0 00010000:00080000:0.0:1789579021.699275:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304335880 x1876509277176832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579021.699287:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277176832:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.699301:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277177344:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.699314:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277176960:0@lo:400:kworker.0 00000100:00100000:0.0:1789579021.699335:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177472:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1789579021.699437:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789579021.699450:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789579021.701016:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579021.701037:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277177600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579021.701100:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579021.701310:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177600 00000100:00100000:1.0:1789579021.701318:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177600 00000100:00100000:1.0:1789579021.701937:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789579021.701948:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277177600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789579021.701971:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1789579021.702020:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277177600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579021.702026:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789579021.702454:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789579021.702460:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789579021.702478:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939304336300, transno 4294967311 00000100:00100000:2.0:1789579021.702519:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277177600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789579022.499612:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579022.691581:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277177728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579022.691674:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579022.691801:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177728 00000100:00100000:1.0:1789579022.691819:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177728 00000100:00100000:1.0:1789579022.691882:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789579022.691892:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277177728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579022.691924:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789579022.691979:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277177728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579022.691987:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789579022.692163:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277177728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579022.695495:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579022.695518:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579022.695589:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579022.695721:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177856 00000100:00100000:1.0:1789579022.695729:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177856 00000100:00100000:1.0:1789579022.695777:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789579022.695786:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579022.695843:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789579022.695903:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579022.695910:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789579022.695992:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789579023.525382:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789579023.718641:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789579023.718657:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789579023.719842:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789579023.719871:0:6469:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939405a01480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789579023.719875:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9393040c7800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939405a01e40 00000020:00080000:1.0:1789579023.719879:0:6469:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9393040c7600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939304a27200 00000020:00080000:1.0:1789579023.719905:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789579023.719961:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789579023.733080:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733099:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733108:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733115:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579023.733120:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733128:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733146:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939412b0fb00) 00010000:00010000:2.0:1789579023.733149:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579023.733154:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579023.733178:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304367600/0xd90373d592f21d19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579024.547507:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579025.571875:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579026.046662:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046701:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046721:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046739:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046762:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046783:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046802:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579026.046835:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411072 00000100:00100000:0.0:1789579026.046845:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411072 00000100:00100000:0.0:1789579026.046894:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410944 00000100:00100000:0.0:1789579026.046897:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410944 00000100:00100000:0.0:1789579026.046916:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:0.0:1789579026.046924:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261411072:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.046985:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261411072:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.046992:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 104 00000100:00100000:0.0:1789579026.047008:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:0.0:1789579026.047014:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261410944:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.047037:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2395:x1876509261410944:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.047043:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 105 00000100:00100000:0.0:1789579026.047057:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410816 00000100:00100000:0.0:1789579026.047060:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410816 00000100:00100000:0.0:1789579026.047290:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411328 00000100:00100000:0.0:1789579026.047294:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411328 00000100:00100000:0.0:1789579026.047321:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410688 00000100:00100000:0.0:1789579026.047323:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410688 00000100:00100000:0.0:1789579026.047334:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411200 00000100:00100000:0.0:1789579026.047336:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411200 00000100:00100000:0.0:1789579026.047368:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 334 00000100:00100000:0.0:1789579026.047375:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261410816:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.047402:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2395:x1876509261410816:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.047408:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 334 00000100:00100000:0.0:1789579026.047419:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 335 00000100:00100000:0.0:1789579026.047424:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261411328:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.047442:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261411328:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 18us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.047447:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 335 00000100:00100000:0.0:1789579026.047456:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 336 00000100:00100000:0.0:1789579026.047461:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2395:x1876509261410688:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.047481:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2395:x1876509261410688:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 20us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.047486:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 336 00000100:00100000:0.0:1789579026.047495:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 337 00000100:00100000:0.0:1789579026.047500:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261411200:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579026.047517:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2395:x1876509261411200:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 17us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.047522:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 337 00000100:00080000:0.0:1789579026.047541:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789579026.047560:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789579026.047563:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789579026.047565:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579026.049892:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261410560 00000100:00100000:3.0:1789579026.049904:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261410560 00000100:00100000:3.0:1789579026.049971:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 391 00000100:00100000:3.0:1789579026.049980:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261410560:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579026.050038:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2395:x1876509261410560:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 60us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579026.050058:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 391 00010000:00010000:3.0:1789579026.596173:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579026.787512:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579026.787595:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.787668:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277177984 00000100:00100000:0.0:1789579026.787676:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277177984 00000100:00100000:0.0:1789579026.787724:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789579026.787733:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579026.787764:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579026.787804:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277177984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.787810:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1789579026.787829:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579026.787859:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277177984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579026.788027:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579026.788041:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277178112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579026.788098:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.788270:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579026.788279:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277178240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579026.792742:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277178368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579026.793033:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277178496:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793092:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793129:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179008:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793150:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793166:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179520:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793185:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793203:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789579026.793208:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277178880:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793239:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793252:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277179392:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793267:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793279:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179904:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793293:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579026.793316:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179008 00000100:00100000:0.0:1789579026.793323:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179008 00000100:00100000:0.0:1789579026.793383:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789579026.793391:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793439:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179008:12345-0@lo:400:kworker.0 Request processed in 48us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.793445:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789579026.793465:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179520 00000100:00100000:0.0:1789579026.793468:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179520 00000100:00100000:0.0:1789579026.793492:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179392 00000100:00100000:0.0:1789579026.793494:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179392 00000100:00100000:0.0:1789579026.793504:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179904 00000100:00100000:0.0:1789579026.793506:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179904 00000100:00100000:0.0:1789579026.793518:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789579026.793524:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793562:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179520:12345-0@lo:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.793568:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789579026.793578:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579026.793593:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793615:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277179392:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.793630:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789579026.793640:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789579026.793645:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793672:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277179904:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.793677:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789579026.793692:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178880 00000100:00100000:0.0:1789579026.793695:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178880 00000100:00100000:0.0:1789579026.793716:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789579026.793722:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277178880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793749:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876509277178880:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579026.793754:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:0.0:1789579026.793777:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579026.793781:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579026.793803:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876509277178880:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793812:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277179392:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793820:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179904:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793826:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179008:0@lo:400:kworker.0 00000100:00100000:0.0:1789579026.793833:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789579026.793838:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789579026.793856:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277179520:0@lo:400:kworker.0 00000100:00100000:3.0:1789579026.794057:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178496 00000100:00100000:3.0:1789579026.794062:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178496 00000100:00100000:3.0:1789579026.794105:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789579026.794111:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277178496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579026.794145:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3616:x1876509277178496:12345-0@lo:400:kworker.0 Request processed in 34us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579026.794151:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789579026.794286:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277178496:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.799994:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277178752:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800050:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800086:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277179264:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800111:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800127:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277179776:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800146:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800163:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789579026.800169:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277178624:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800188:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800202:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277179136:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800221:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800247:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277179648:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800265:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800292:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178752 00000100:00100000:1.0:1789579026.800299:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178752 00000100:00100000:1.0:1789579026.800336:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789579026.800344:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277178752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800420:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277178752:12345-0@lo:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800426:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789579026.800449:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179264 00000100:00100000:1.0:1789579026.800452:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179264 00000100:00100000:1.0:1789579026.800476:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179776 00000100:00100000:1.0:1789579026.800478:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179776 00000100:00100000:1.0:1789579026.800488:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178624 00000100:00100000:1.0:1789579026.800490:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178624 00000100:00100000:1.0:1789579026.800498:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179136 00000100:00100000:1.0:1789579026.800500:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179136 00000100:00100000:1.0:1789579026.800510:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277179648 00000100:00100000:1.0:1789579026.800512:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277179648 00000100:00100000:1.0:1789579026.800532:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789579026.800537:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277179264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800580:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277179264:12345-0@lo:400:kworker.0 Request processed in 43us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800586:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789579026.800596:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789579026.800601:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277179776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800622:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277179776:12345-0@lo:400:kworker.0 Request processed in 21us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800626:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789579026.800636:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789579026.800640:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277178624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800662:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277178624:12345-0@lo:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789579026.800677:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789579026.800682:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277179136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800701:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277179136:12345-0@lo:400:kworker.0 Request processed in 20us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800707:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789579026.800715:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789579026.800720:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277179648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800738:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277179648:12345-0@lo:400:kworker.0 Request processed in 19us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579026.800743:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:1.0:1789579026.800772:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579026.800775:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579026.800784:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800814:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579026.800864:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277178624:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800874:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277179136:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800882:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277179648:0@lo:400:kworker.0 00000100:00100000:1.0:1789579026.800889:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277178752:0@lo:400:kworker.0 00010000:00080000:1.0:1789579026.800899:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31f80 x1876509277179264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579026.800909:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277179264:0@lo:400:kworker.0 00010000:00080000:1.0:1789579026.800917:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32680 x1876509277179776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579026.800925:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277179776:0@lo:400:kworker.0 00000100:00100000:2.0:1789579026.801148:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178112 00000100:00100000:2.0:1789579026.801154:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178112 00000100:00100000:2.0:1789579026.801173:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178240 00000100:00100000:2.0:1789579026.801175:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178240 00000100:00100000:2.0:1789579026.801184:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277178368 00000100:00100000:2.0:1789579026.801186:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277178368 00000100:00100000:2.0:1789579026.801197:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789579026.801203:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277178112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789579026.801222:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789579026.801262:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277178112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (13164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579026.801268:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789579026.801279:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789579026.801285:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277178240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579026.801293:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789579026.801318:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277178240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579026.801323:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789579026.801333:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789579026.801338:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277178368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579026.801346:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789579026.801391:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277178368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579026.801403:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789579026.801430:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277178240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579026.801455:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277178368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579026.803706:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277178112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579027.411563:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579027.411694:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411456 00000100:00100000:1.0:1789579027.411704:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411456 00000100:00100000:1.0:1789579027.411766:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 254 00000100:00100000:1.0:1789579027.411775:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+18:12128:x1876509261411456:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789579027.411867:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28fc5077-c53d-437a-bade-84c159d25114+18:12128:x1876509261411456:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579027.411874:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 254 00000100:00100000:3.0:1789579027.416210:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579027.416532:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411584 00000100:00100000:1.0:1789579027.416561:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411584 00000100:00100000:1.0:1789579027.416621:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 255 00000100:00100000:1.0:1789579027.416630:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:12128:x1876509261411584:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789579027.416725:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:12128:x1876509261411584:12345-192.168.203.37@tcp:60:lhsmtool_posix.0 Request processed in 96us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579027.416733:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 255 00000100:00100000:0.0:1789579027.435766:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579027.436030:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411840 00000100:00100000:1.0:1789579027.436039:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411840 00000100:00100000:1.0:1789579027.436103:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789579027.436113:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+18:12128:x1876509261411840:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789579027.436325:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28fc5077-c53d-437a-bade-84c159d25114+19:12128:x1876509261411840:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 212us (566us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789579027.436333:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00010000:00010000:0.0:1789579027.619523:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579027.811836:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277180032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579027.811971:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579027.812250:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180032 00000100:00100000:1.0:1789579027.812258:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180032 00000100:00100000:1.0:1789579027.812306:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789579027.812314:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277180032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579027.812345:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789579027.812406:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277180032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579027.812413:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789579027.813588:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579027.813741:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277180160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579027.813779:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579027.813819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180160 00000100:00100000:1.0:1789579027.813824:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180160 00000100:00100000:1.0:1789579027.813860:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789579027.813866:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277180160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579027.813950:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789579027.813996:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277180160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579027.814003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789579027.814040:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277180160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579027.815181:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277180032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789579028.645211:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579029.669945:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789579029.787991:0:14933:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:17:07 (1789579027) 00000001:00080000:1.0:1789579029.861949:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789579029.861964:0:6469:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789579029.862000:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789579029.862011:0:6522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789579030.245633:0:13770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789579030.245733:0:13770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789579030.245844:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789579030.245852:0:13770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789579030.629495:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789579030.692310:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579031.170293:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579031.170378:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579031.170481:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412096 00000100:00100000:1.0:1789579031.170491:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412096 00000100:00100000:1.0:1789579031.170562:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 344 00000100:00100000:1.0:1789579031.170572:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2393:x1876509261412096:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579031.170644:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2393:x1876509261412096:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579031.170652:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 344 00000100:00080000:2.0:1789579031.171102:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579031.179894:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261411968 00000100:00100000:0.0:1789579031.179907:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261411968 00000100:00100000:0.0:1789579031.179981:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 393 00000100:00100000:0.0:1789579031.179991:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261411968:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579031.180064:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2393:x1876509261411968:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 74us (9780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.180072:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 393 00000100:00100000:3.0:1789579031.187070:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579031.187107:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579031.187129:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579031.187151:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579031.187172:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579031.187200:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412608 00000100:00100000:3.0:1789579031.187209:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412608 00000100:00100000:3.0:1789579031.187261:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412224 00000100:00100000:3.0:1789579031.187264:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412224 00000100:00100000:3.0:1789579031.187279:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412736 00000100:00100000:3.0:1789579031.187281:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412736 00000100:00100000:3.0:1789579031.187310:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 345 00000100:00100000:3.0:1789579031.187318:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261412608:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579031.187406:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261412608:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.187413:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 345 00000100:00100000:3.0:1789579031.187444:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 346 00000100:00100000:3.0:1789579031.187451:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261412224:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579031.187476:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261412224:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.187482:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 346 00000100:00100000:3.0:1789579031.187494:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 347 00000100:00100000:3.0:1789579031.187500:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261412736:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579031.187535:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2392:x1876509261412736:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.187541:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 347 00000100:00080000:3.0:1789579031.187561:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579031.187564:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579031.188182:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412352 00000100:00100000:0.0:1789579031.188188:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412352 00000100:00100000:0.0:1789579031.188233:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412480 00000100:00100000:0.0:1789579031.188236:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412480 00000100:00100000:0.0:1789579031.188254:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:0.0:1789579031.188261:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261412352:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579031.188297:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+7:2392:x1876509261412352:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.188303:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 109 00000100:00100000:0.0:1789579031.188318:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00100000:0.0:1789579031.188324:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261412480:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579031.188398:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2392:x1876509261412480:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 72us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.188407:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 110 00000100:00080000:1.0:1789579031.188610:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789579031.188614:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789579031.718589:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579031.907631:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277180288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789579031.907717:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.907748:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277180416:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.907784:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277180800:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.907793:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.907821:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.907839:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277180928:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.907848:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277181312:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.907878:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.907883:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.907908:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277181440:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.907931:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.907947:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277181952:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.907964:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.907981:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789579031.907987:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277180544:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.908006:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.908024:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277181056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.908043:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.908059:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277181568:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908066:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277181824:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.908082:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.908108:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.908118:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180928 00000100:00100000:1.0:1789579031.908125:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180928 00000100:00100000:3.0:1789579031.908134:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789579031.908142:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277180672:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908173:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579031.908174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789579031.908187:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908197:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277181184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908223:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.908245:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277181696:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908268:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.908303:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180288 00000100:00100000:3.0:1789579031.908307:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180288 00000100:00100000:1.0:1789579031.908454:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277180928:12345-0@lo:400:kworker.0 Request processed in 68us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579031.908465:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789579031.908529:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789579031.908538:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277180288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789579031.908558:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789579031.908645:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277180288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.908653:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789579031.908674:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180800 00000100:00100000:3.0:1789579031.908679:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180800 00000100:00100000:3.0:1789579031.908791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180544 00000100:00100000:3.0:1789579031.908796:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180544 00000100:00100000:3.0:1789579031.908811:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181056 00000100:00100000:3.0:1789579031.908813:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181056 00000100:00100000:3.0:1789579031.908828:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181568 00000100:00100000:3.0:1789579031.908830:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181568 00000100:00100000:3.0:1789579031.908846:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181184 00000100:00100000:3.0:1789579031.908849:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181184 00000100:00100000:3.0:1789579031.908862:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181696 00000100:00100000:3.0:1789579031.908864:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181696 00000100:00100000:3.0:1789579031.908881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789579031.908896:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277180800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.908994:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277180800:12345-0@lo:400:kworker.0 Request processed in 100us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909002:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789579031.909016:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789579031.909022:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277180544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909050:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277180544:12345-0@lo:400:kworker.0 Request processed in 28us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909056:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789579031.909067:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789579031.909073:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909100:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277181056:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909105:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789579031.909118:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789579031.909125:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909152:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277181568:12345-0@lo:400:kworker.0 Request processed in 29us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909156:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789579031.909167:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789579031.909174:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277181184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909199:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277181184:12345-0@lo:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909206:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789579031.909216:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789579031.909230:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277181696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909260:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277181696:12345-0@lo:400:kworker.0 Request processed in 32us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909266:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789579031.909285:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181312 00000100:00100000:3.0:1789579031.909288:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181312 00000100:00100000:3.0:1789579031.909307:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181440 00000100:00100000:3.0:1789579031.909309:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181440 00000100:00100000:3.0:1789579031.909321:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181952 00000100:00100000:3.0:1789579031.909324:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181952 00000100:00100000:3.0:1789579031.909335:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277181824 00000100:00100000:3.0:1789579031.909337:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277181824 00000100:00100000:3.0:1789579031.909370:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789579031.909455:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909491:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277181312:12345-0@lo:400:kworker.0 Request processed in 115us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909498:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789579031.909524:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789579031.909531:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277181440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180672 00000100:00100000:1.0:1789579031.909544:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180672 00000100:00100000:3.0:1789579031.909563:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277181440:12345-0@lo:400:kworker.0 Request processed in 32us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579031.909569:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789579031.909574:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789579031.909579:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277180672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909592:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789579031.909617:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277180672:12345-0@lo:400:kworker.0 Request processed in 40us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579031.909632:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789579031.909668:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277181952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909675:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277180544:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909687:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277181056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909696:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277181568:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909706:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277180928:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.909716:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277181440:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909797:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277181952:12345-0@lo:400:kworker.0 Request processed in 133us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909804:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789579031.909823:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789579031.909829:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277181824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.909859:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277181824:12345-0@lo:400:kworker.0 Request processed in 30us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579031.909864:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789579031.909901:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579031.909906:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579031.909908:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579031.909984:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579031.910033:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277182080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579031.910065:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579031.910110:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277180672:0@lo:400:kworker.0 00010000:00080000:3.0:1789579031.910123:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bfb80 x1876509277181184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579031.910134:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277181184:0@lo:400:kworker.0 00010000:00080000:3.0:1789579031.910143:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394362bc700 x1876509277181696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579031.910152:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277181696:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.910162:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277180800:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.910171:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277181312:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.910179:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277181824:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.910193:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277180288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579031.910870:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277180416 00000100:00100000:0.0:1789579031.910878:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277180416 00000100:00100000:0.0:1789579031.910989:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789579031.910997:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277180416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579031.911041:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394060b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277180416:12345-0@lo:400:kworker.0 Request processed in 45us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.911047:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789579031.911112:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182080 00000100:00100000:0.0:1789579031.911115:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182080 00000100:00100000:0.0:1789579031.911140:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789579031.911146:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277182080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579031.911159:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789579031.911195:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277182080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.911201:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789579031.911225:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579031.911251:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579031.911284:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182208 00000100:00100000:0.0:1789579031.911288:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182208 00000100:00100000:0.0:1789579031.911308:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789579031.911314:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579031.911334:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579031.911385:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.911391:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789579031.911423:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579031.911463:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277182080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579031.911566:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277180416:0@lo:400:kworker.0 00000100:00100000:1.0:1789579031.911578:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277181952:0@lo:400:kworker.0 00000100:00100000:3.0:1789579031.913863:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277182336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579031.913930:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579031.914297:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182336 00000100:00100000:0.0:1789579031.914305:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182336 00000100:00100000:0.0:1789579031.914389:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789579031.914399:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277182336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579031.914418:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579031.914461:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277182336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579031.914467:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789579031.914572:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277182336:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789579032.739650:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579032.931655:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277182464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579032.931724:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579032.931835:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182464 00000100:00100000:1.0:1789579032.931843:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182464 00000100:00100000:1.0:1789579032.931894:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789579032.932028:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277182464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579032.932062:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789579032.932114:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277182464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 212us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579032.932120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789579032.932703:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277182464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579032.932834:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277182592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579032.932870:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579032.933051:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182592 00000100:00100000:1.0:1789579032.933056:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182592 00000100:00100000:1.0:1789579032.933090:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789579032.933098:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277182592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579032.933118:0:9869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789579032.933165:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277182592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579032.933184:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789579032.933608:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277182592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579033.262259:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579033.262474:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261412864 00000100:00100000:0.0:1789579033.262487:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261412864 00000100:00100000:0.0:1789579033.262584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 256 00000100:00100000:0.0:1789579033.262596:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:13148:x1876509261412864:12345-192.168.203.37@tcp:101:lsof.0 00010000:00010000:0.0:1789579033.262617:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579033.262649:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec29b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.262712:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.262727:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.262758:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579033.263039:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789579033.263043:0:6490:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579033.263085:0:6490:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.263110:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436a00/0xd90373d592f21da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec29b expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.263142:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec29b expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579033.263151:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:0.0:1789579033.263153:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789579033.263157:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789579033.263218:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:13148:x1876509261412864:12345-192.168.203.37@tcp:101:lsof.0 Request processed in 624us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579033.263225:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 256 00000100:00080000:3.0:1789579033.263973:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789579033.763601:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579034.481982:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579034.482394:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261413120 00000100:00100000:2.0:1789579034.482404:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261413120 00000100:00100000:2.0:1789579034.482471:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:2.0:1789579034.482489:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+18:13150:x1876509261413120:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:2.0:1789579034.482716:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+19:13150:x1876509261413120:12345-192.168.203.37@tcp:35:umount.0 Request processed in 236us (753us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789579034.482724:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00080000:3.0:1789579034.483057:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579034.490121:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579034.493861:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261413376 00000100:00100000:0.0:1789579034.493877:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261413376 00000100:00100000:0.0:1789579034.494067:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:0.0:1789579034.494080:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+19:13150:x1876509261413376:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:0.0:1789579034.494595:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+20:13150:x1876509261413376:12345-192.168.203.37@tcp:35:umount.0 Request processed in 516us (4481us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789579034.494603:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:2.0:1789579034.501388:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579034.501525:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261413632 00000100:00100000:0.0:1789579034.501536:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261413632 00000100:00100000:0.0:1789579034.501599:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:0.0:1789579034.501608:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93941b602450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+20:13150:x1876509261413632:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:0.0:1789579034.501830:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93941b602450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+21:13150:x1876509261413632:12345-192.168.203.37@tcp:35:umount.0 Request processed in 221us (450us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789579034.501837:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:3.0:1789579034.524586:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579034.524879:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261413888 00000100:00100000:0.0:1789579034.524888:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261413888 00000100:00100000:0.0:1789579034.527529:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789579034.527546:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+21:13150:x1876509261413888:12345-192.168.203.37@tcp:35:umount.0 00000100:00100000:0.0:1789579034.527831:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28fc5077-c53d-437a-bade-84c159d25114+22:13150:x1876509261413888:12345-192.168.203.37@tcp:35:umount.0 Request processed in 290us (3251us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789579034.527839:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:2.0:1789579034.531590:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579034.531630:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579034.531659:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579034.531781:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261414016 00000100:00100000:1.0:1789579034.531791:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261414016 00000100:00100000:1.0:1789579034.531855:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261414272 00000100:00100000:1.0:1789579034.531859:0:6477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261414272 00000100:00100000:0.0:1789579034.531869:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261414144 00000100:00100000:0.0:1789579034.531874:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261414144 00000100:00100000:1.0:1789579034.531885:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789579034.531893:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d510876f-b8d4-4b66-af39-9463dcf1db3f+15:2392:x1876509261414016:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579034.531913:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579034.531932:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436e00/0xd90373d592f20d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdf5 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.531948:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579034.531995:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d510876f-b8d4-4b66-af39-9463dcf1db3f+14:2392:x1876509261414016:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 102us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579034.532003:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789579034.532011:0:13705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:0.0:1789579034.532018:0:13705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d510876f-b8d4-4b66-af39-9463dcf1db3f+14:2392:x1876509261414272:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579034.532027:0:13705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789579034.532035:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00010000:00010000:0.0:1789579034.532037:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519a00/0xd90373d592f20fe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebece expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579034.532041:0:6477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d510876f-b8d4-4b66-af39-9463dcf1db3f+13:2392:x1876509261414144:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579034.532047:0:13705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789579034.532048:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579034.532055:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e200/0xd90373d592f20cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdb6 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.532062:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579034.532065:0:13705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2392:x1876509261414272:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 49us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579034.532071:0:13705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:1.0:1789579034.532075:0:6477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d510876f-b8d4-4b66-af39-9463dcf1db3f+11:2392:x1876509261414144:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579034.542263:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579034.542603:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261414400 00000100:00100000:3.0:1789579034.542613:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261414400 00000100:00100000:3.0:1789579034.542688:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 80 00000100:00100000:3.0:1789579034.542700:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261414400:12345-192.168.203.37@tcp:9:umount.0 00000020:00000080:3.0:1789579034.542730:0:8404:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f210af 00000100:00080000:3.0:1789579034.542740:0:8404:0:(import.c:65:import_set_state_nolock()) ffff939418b25000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579034.542784:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789579034.542941:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28fc5077-c53d-437a-bade-84c159d25114+2:2391:x1876509261414400:12345-192.168.203.37@tcp:9:umount.0 Request processed in 243us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579034.542949:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 80 00010000:00010000:3.0:1789579034.542970:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579034.545577:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579034.548273:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789579034.551254:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579034.551417:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261414784 00000100:00100000:0.0:1789579034.551427:0:8405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261414784 00000100:00100000:0.0:1789579034.551505:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 81 00000100:00100000:0.0:1789579034.551516:0:8405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+7:2391:x1876509261414784:12345-192.168.203.37@tcp:9:umount.0 00000020:00000080:0.0:1789579034.551546:0:8405:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2131e 00000020:00010000:0.0:1789579034.551553:0:8405:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93943f581800: total 0 00000100:00080000:0.0:1789579034.551558:0:8405:0:(import.c:65:import_set_state_nolock()) ffff939304137800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579034.551596:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789579034.551738:0:8405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261414784:12345-192.168.203.37@tcp:9:umount.0 Request processed in 223us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579034.551745:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 81 00000020:00010000:2.0:1789579034.552476:0:10313:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93943f581800: total 0 00010000:00010000:2.0:1789579034.552537:0:10313:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93943f581800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789579034.552625:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ae8085/0xd90373d592f21d9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec294 expref: 4 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579034.552684:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067ef498/0xd90373d592f216dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b8 expref: 3 pid: 10029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579034.552700:0:10313:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93943f581800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789579034.552730:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579034.552733:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579034.552734:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579034.552913:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579034.579704:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579034.579809:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261415808 00000100:00100000:0.0:1789579034.579820:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261415808 00000100:00100000:0.0:1789579034.579889:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 257 00000100:00100000:0.0:1789579034.579900:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+22:2391:x1876509261415808:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:0.0:1789579034.579932:0:6492:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ce2 00000020:00010000:0.0:1789579034.579948:0:6492:0:(genops.c:1920:obd_stale_export_put()) Put export ffff939303512800: total 0 00000100:00080000:0.0:1789579034.579954:0:6492:0:(import.c:65:import_set_state_nolock()) ffff939303514000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579034.579985:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1789579034.580004:0:10312:0:(genops.c:1906:obd_stale_export_get()) Get export ffff939303512800: total 0 00010000:00010000:1.0:1789579034.580066:0:10312:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff939303512800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789579034.580098:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:1.0:1789579034.580101:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789579034.580109:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394421c7c00/0xd90373d592f21754 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0d4 expref: 21 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.580131:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789579034.580133:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789579034.580137:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af200/0xd90373d592f21085 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebef8 expref: 20 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.580149:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939412b0f000) 00010000:00010000:1.0:1789579034.580152:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789579034.580155:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37c00/0xd90373d592f21380 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebfd1 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579034.580165:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28fc5077-c53d-437a-bade-84c159d25114+18:2391:x1876509261415808:12345-192.168.203.37@tcp:39:umount.0 Request processed in 267us (469us total) trans 4294967527 rc 0/0 00010000:00010000:1.0:1789579034.580172:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00000100:00100000:0.0:1789579034.580172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 257 00010000:00010000:1.0:1789579034.580174:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579034.580178:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36e00/0xd90373d592f21d5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec27f expref: 18 pid: 9792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.580188:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939410126200) 00010000:00010000:1.0:1789579034.580191:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579034.580194:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f2102a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebee3 expref: 16 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579034.580209:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:1.0:1789579034.580212:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579034.580221:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437800/0xd90373d592f2169e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0a3 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581182:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579034.581189:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789579034.581195:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37400/0xd90373d592f21d89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec28d expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581229:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789579034.581232:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789579034.581236:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a36600/0xd90373d592f216c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0b1 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581249:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939410126600) 00010000:00010000:0.0:1789579034.581251:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789579034.581263:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303a37600/0xd90373d592f21a41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec1ad expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581295:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:0.0:1789579034.581298:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789579034.581302:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae800/0xd90373d592f21738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec0cd expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581316:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939405f07f00) 00010000:00010000:0.0:1789579034.581318:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579034.581322:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436c00/0xd90373d592f21c7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec247 expref: 10 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581338:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939412b0fc00) 00010000:00010000:0.0:1789579034.581340:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579034.581343:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436400/0xd90373d592f215be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec06b expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581377:0:10312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939302356c00) 00010000:00010000:0.0:1789579034.581380:0:10312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789579034.581391:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2100e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebedc expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579034.581414:0:10312:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff939303512800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789579034.581442:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579034.581444:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579034.581446:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579034.605948:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579034.606218:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261415936 00000100:00100000:3.0:1789579034.606227:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261415936 00000100:00100000:3.0:1789579034.606304:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 258 00000100:00100000:3.0:1789579034.606316:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+5:2391:x1876509261415936:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:3.0:1789579034.606401:0:9792:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ce9 00000100:00080000:3.0:1789579034.606419:0:9792:0:(import.c:65:import_set_state_nolock()) ffff9393038d2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579034.606445:0:9792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789579034.606631:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28fc5077-c53d-437a-bade-84c159d25114+3:2391:x1876509261415936:12345-192.168.203.37@tcp:39:umount.0 Request processed in 318us (691us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789579034.606639:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 258 00010000:00010000:2.0:1789579034.606726:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579034.606829:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789579034.788007:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579035.811601:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789579036.015482:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000001:00080000:1.0:1789579036.015501:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789579036.015512:0:6469:0:(genops.c:885:class_export_put()) final put ffff939303512800/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:2.0:1789579036.015916:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939303512800/28fc5077-c53d-437a-bade-84c159d25114 for lustre-MDT0000 00000020:00000080:2.0:1789579036.015987:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939303514000 for lustre-MDT0000 00000100:00100000:2.0:1789579036.281553:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579036.281599:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579036.281632:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579036.281709:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416320 00000100:00100000:0.0:1789579036.281719:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416320 00000100:00100000:0.0:1789579036.281782:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416192 00000100:00100000:0.0:1789579036.281786:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416192 00000100:00100000:0.0:1789579036.281823:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 354 00000100:00100000:0.0:1789579036.281832:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261416320:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579036.281896:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2394:x1876509261416320:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579036.281904:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 354 00000100:00100000:0.0:1789579036.281922:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 355 00000100:00100000:0.0:1789579036.281929:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2394:x1876509261416192:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579036.281955:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2394:x1876509261416192:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579036.281960:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 355 00000100:00080000:2.0:1789579036.282429:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789579036.282434:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789579036.282711:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416064 00000100:00100000:3.0:1789579036.282718:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416064 00000100:00100000:3.0:1789579036.282758:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 395 00000100:00100000:3.0:1789579036.282766:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261416064:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579036.282820:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2394:x1876509261416064:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 55us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579036.282826:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 395 00000100:00100000:2.0:1789579036.536198:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579036.536291:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579036.538197:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579036.539366:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416448 00000100:00100000:0.0:1789579036.539378:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416448 00000100:00100000:0.0:1789579036.539544:0:13705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416704 00000100:00100000:0.0:1789579036.539548:0:13705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416704 00000100:00100000:2.0:1789579036.539586:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416576 00000100:00100000:2.0:1789579036.539590:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416576 00000100:00100000:3.0:1789579036.539610:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789579036.539625:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:2393:x1876509261416448:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579036.539646:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789579036.539658:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00010000:00010000:3.0:1789579036.539666:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2fa00/0xd90373d592f20de5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe0a expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579036.539671:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+12:2393:x1876509261416704:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579036.539687:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579036.539691:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579036.539711:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518c00/0xd90373d592f20fdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebec7 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579036.539739:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+10:2393:x1876509261416448:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 119us (3551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579036.539747:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789579036.539767:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789579036.539774:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+9:2393:x1876509261416576:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579036.539787:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579036.539795:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e000/0xd90373d592f20dec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebe3b expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579036.539804:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579036.539805:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579036.539824:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:2393:x1876509261416576:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 50us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579036.539831:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:2.0:1789579036.539837:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d510876f-b8d4-4b66-af39-9463dcf1db3f+8:2393:x1876509261416704:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 168us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579036.539846:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789579036.548920:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579036.548989:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261416960 00000100:00100000:3.0:1789579036.549004:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261416960 00000100:00100000:3.0:1789579036.549057:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 259 00000100:00100000:3.0:1789579036.549067:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+6:2391:x1876509261416960:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:3.0:1789579036.549108:0:9792:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20dfa 00000020:00010000:3.0:1789579036.549116:0:9792:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93943f584000: total 0 00000100:00080000:3.0:1789579036.549121:0:9792:0:(import.c:65:import_set_state_nolock()) ffff93943f586000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579036.549146:0:9792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1789579036.549286:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2391:x1876509261416960:12345-192.168.203.37@tcp:39:umount.0 Request processed in 220us (373us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789579036.549294:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 259 00000020:00010000:2.0:1789579036.549427:0:10313:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93943f584000: total 0 00010000:00010000:2.0:1789579036.549483:0:10313:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93943f584000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789579036.549516:0:10313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9394091b5700) 00010000:00010000:2.0:1789579036.549520:0:10313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579036.549528:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437200/0xd90373d592f21dac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec29b expref: 4 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579036.549546:0:10313:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93943f584000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789579036.549558:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579036.549560:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579036.549562:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579036.559381:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579036.559754:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417088 00000100:00100000:0.0:1789579036.559768:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417088 00000100:00100000:0.0:1789579036.559982:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 260 00000100:00100000:0.0:1789579036.560122:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+5:2391:x1876509261417088:12345-192.168.203.37@tcp:39:umount.0 00000020:00000080:0.0:1789579036.560183:0:6491:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20e01 00000100:00080000:0.0:1789579036.560197:0:6491:0:(import.c:65:import_set_state_nolock()) ffff93943f582800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579036.560284:0:6491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789579036.560563:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb97d94f-5343-4111-9eea-cc9a295afa74+3:2391:x1876509261417088:12345-192.168.203.37@tcp:39:umount.0 Request processed in 570us (1225us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789579036.560571:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 260 00010000:00010000:3.0:1789579036.568855:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579036.592285:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579036.592456:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417344 00000100:00100000:0.0:1789579036.592479:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417344 00000100:00100000:0.0:1789579036.592548:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 396 00000100:00100000:0.0:1789579036.592561:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+7:2391:x1876509261417344:12345-192.168.203.37@tcp:251:umount.0 00000020:00000080:0.0:1789579036.592619:0:6485:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20cbf 00000020:00010000:0.0:1789579036.592629:0:6485:0:(genops.c:1920:obd_stale_export_put()) Put export ffff939303517800: total 0 00000100:00080000:0.0:1789579036.592635:0:6485:0:(import.c:65:import_set_state_nolock()) ffff939303513800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789579036.592737:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d510876f-b8d4-4b66-af39-9463dcf1db3f+3:2391:x1876509261417344:12345-192.168.203.37@tcp:251:umount.0 Request processed in 178us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579036.592745:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 396 00000020:00010000:2.0:1789579036.595787:0:6478:0:(genops.c:1906:obd_stale_export_get()) Get export ffff939303517800: total 0 00010000:00010000:2.0:1789579036.595897:0:6478:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff939303517800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789579036.595952:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363aea00/0xd90373d592f20d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ebdfc expref: 2 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579036.595975:0:6478:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff939303517800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789579036.595986:0:6478:0:(genops.c:885:class_export_put()) final put ffff939303517800/d510876f-b8d4-4b66-af39-9463dcf1db3f 00010000:00010000:2.0:1789579036.596029:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579036.596031:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579036.596033:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789579036.596211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939303517800/d510876f-b8d4-4b66-af39-9463dcf1db3f for MGS 00000020:00000080:3.0:1789579036.596276:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939303513800 for MGS 00010000:00010000:3.0:1789579036.837619:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579037.028625:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579037.028733:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.028818:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579037.028826:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579037.028852:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.028891:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182720 00000100:00100000:1.0:1789579037.028901:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182720 00000100:00100000:1.0:1789579037.028964:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182848 00000100:00100000:1.0:1789579037.028968:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182848 00000100:00100000:1.0:1789579037.028989:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789579037.029000:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789579037.029035:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789579037.029104:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.029111:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789579037.029132:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789579037.029138:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579037.029155:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789579037.029183:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277182848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.029207:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1789579037.029229:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579037.029234:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579037.029278:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579037.029296:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277182720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579037.029502:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277182976:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029536:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029564:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277183488:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029588:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029608:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277184000:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029631:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029651:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789579037.029655:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277183104:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029676:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029694:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277183616:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029714:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029729:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277184128:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029748:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.029778:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277182976 00000100:00100000:1.0:1789579037.029783:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277182976 00000100:00100000:1.0:1789579037.029815:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789579037.029821:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277182976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029856:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3615:x1876509277182976:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.029876:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789579037.029909:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183488 00000100:00100000:1.0:1789579037.029913:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183488 00000100:00100000:1.0:1789579037.029938:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789579037.029945:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277183488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.029979:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277183488:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.029985:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789579037.030002:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184000 00000100:00100000:1.0:1789579037.030005:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184000 00000100:00100000:1.0:1789579037.030038:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183104 00000100:00100000:1.0:1789579037.030041:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183104 00000100:00100000:1.0:1789579037.030053:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183616 00000100:00100000:1.0:1789579037.030056:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183616 00000100:00100000:1.0:1789579037.030067:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184128 00000100:00100000:1.0:1789579037.030069:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184128 00000100:00100000:1.0:1789579037.030083:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789579037.030088:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277184000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030120:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277184000:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030126:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789579037.030137:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789579037.030143:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277183104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030167:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277183104:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030173:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789579037.030184:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789579037.030197:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277183616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030224:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277183616:12345-0@lo:400:kworker.0 Request processed in 29us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030230:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789579037.030241:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789579037.030246:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277184128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030266:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277184128:12345-0@lo:400:kworker.0 Request processed in 21us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030270:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00080000:1.0:1789579037.030303:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579037.030306:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579037.030324:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277183104:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030333:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277183616:0@lo:400:kworker.0 00010000:00080000:1.0:1789579037.030343:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930439bb80 x1876509277184128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579037.030381:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277184128:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030389:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277182976:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030397:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277183488:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030404:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277184000:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030434:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277183232:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030460:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.030497:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277183744:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030531:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.030549:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277184256:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030572:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.030594:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789579037.030600:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277183360:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030621:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.030637:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277183872:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030655:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579037.030683:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183232 00000100:00100000:1.0:1789579037.030687:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183232 00000100:00100000:1.0:1789579037.030713:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789579037.030721:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277183232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030759:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277183232:12345-0@lo:400:kworker.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030764:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789579037.030782:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184256 00000100:00100000:1.0:1789579037.030785:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184256 00000100:00100000:1.0:1789579037.030814:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183872 00000100:00100000:1.0:1789579037.030817:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183872 00000100:00100000:1.0:1789579037.030840:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789579037.030846:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277184256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030879:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277184256:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030885:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789579037.030898:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789579037.030903:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277183872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.030941:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277183872:12345-0@lo:400:kworker.0 Request processed in 38us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.030947:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789579037.030971:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183744 00000100:00100000:1.0:1789579037.030974:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183744 00000100:00100000:1.0:1789579037.031000:0:9792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277183360 00000100:00100000:1.0:1789579037.031002:0:9792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277183360 00000100:00100000:1.0:1789579037.031017:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789579037.031023:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277183744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.031052:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277183744:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.031058:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789579037.031069:0:9792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789579037.031074:0:9792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277183360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.031097:0:9792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277183360:12345-0@lo:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579037.031102:0:9792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:1.0:1789579037.031119:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579037.031123:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579037.031125:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579037.031152:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277183360:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.031162:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277183872:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.031171:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277183232:0@lo:400:kworker.0 00010000:00080000:1.0:1789579037.031181:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304399f80 x1876509277183744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579037.031203:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277183744:0@lo:400:kworker.0 00000100:00100000:1.0:1789579037.031215:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277184256:0@lo:400:kworker.0 00000100:00100000:0.0:1789579037.036661:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789579037.036694:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277184384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579037.036782:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579037.037035:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184384 00000100:00100000:3.0:1789579037.037046:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184384 00000100:00100000:3.0:1789579037.037119:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789579037.037130:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277184384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579037.037192:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789579037.037268:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277184384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579037.037285:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789579037.037526:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277184384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579037.038181:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579037.038201:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277184512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579037.038253:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579037.045770:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184512 00000100:00100000:0.0:1789579037.045787:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184512 00000100:00100000:0.0:1789579037.045916:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789579037.045929:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277184512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579037.045975:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789579037.046117:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277184512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (7862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579037.046126:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789579037.047152:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277184512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579037.860449:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579038.051631:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579038.051664:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277184640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579038.051763:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579038.052244:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184640 00000100:00100000:1.0:1789579038.052258:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184640 00000100:00100000:2.0:1789579038.052583:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789579038.052601:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277184640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789579038.052649:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789579038.052723:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277184640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579038.052731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789579038.052794:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277184640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579038.057571:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579038.057606:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277184768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579038.057708:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579038.057817:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184768 00000100:00100000:2.0:1789579038.057827:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184768 00000100:00100000:2.0:1789579038.057901:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789579038.057912:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277184768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579038.057958:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789579038.058021:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277184768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579038.058029:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789579038.058163:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277184768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789579038.883906:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789579039.100397:0:15129:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789579039.141218:0:15129:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789579039.141298:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.141318:0:15129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.141326:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.141335:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.141397:0:15129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789579039.141404:0:15129:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789579039.144641:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579039.144653:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789579039.144674:0:15129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579039.144711:0:15129:0:(import.c:65:import_set_state_nolock()) ffff939436230000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789579039.144753:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579039.144764:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.144794:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579039.144799:0:10312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.144823:0:10312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579039.144832:0:10312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579039.144837:0:10312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579039.144840:0:10312:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789579039.144844:0:10312:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789579039.144880:0:10312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.144886:0:10312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579039.144916:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.144934:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303a37000/0xd90373d592f20d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d7c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.144949:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579039.144950:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579039.144952:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579039.144973:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277184896:0@lo:39:umount.0 00000100:00100000:1.0:1789579039.146157:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579039.146187:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277185024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579039.146281:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579039.146400:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185024 00000100:00100000:1.0:1789579039.146410:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185024 00000100:00100000:1.0:1789579039.149222:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579039.149237:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394362bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+24:3617:x1876509277185024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579039.149270:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579039.152238:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277184896 00000100:00100000:2.0:1789579039.153196:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277184896 00000100:00100000:2.0:1789579039.153300:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789579039.153312:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876509277184896:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789579039.153366:0:6491:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f208d6 00000100:00080000:2.0:1789579039.153378:0:6491:0:(import.c:65:import_set_state_nolock()) ffff93942a0b3800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789579039.154380:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579039.154417:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437400/0xd90373d592f20d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20d75 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.154457:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579039.154565:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394362bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3617:x1876509277185024:12345-0@lo:103:ldlm_bl.0 Request processed in 5331us (8284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579039.154597:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579039.154693:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277185024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579039.156545:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3614:x1876509277184896:12345-0@lo:39:umount.0 Request processed in 3222us (8111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579039.156586:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789579039.156604:0:6491:0:(genops.c:885:class_export_put()) final put ffff93942a0b6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789579039.157564:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942a0b6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789579039.157643:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942a0b3800 for lustre-MDT0000 00000100:00080000:3.0:1789579039.158405:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436230000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1789579039.158527:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579039.159408:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277184896:0@lo:39:umount.0 00000100:00080000:3.0:1789579039.159475:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579039.159481:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789579039.159486:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789579039.167406:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167443:0:15129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167461:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167468:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167498:0:15129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579039.167507:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167515:0:15129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167523:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167529:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167544:0:15129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789579039.167571:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167578:0:15129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167585:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167592:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167616:0:15129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789579039.167623:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167630:0:15129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167637:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167643:0:15129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.167655:0:15129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789579039.167659:0:15129:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789579039.167707:0:15129:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789579039.167712:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789579039.167717:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579039.167724:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:3.0:1789579039.167739:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93942ef74800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579039.167747:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff939302080000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579039.167752:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93942ee06800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579039.167756:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93942ee04000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789579039.167764:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93943f584000 eb97d94f-5343-4111-9eea-cc9a295afa74 192.168.203.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579039.167769:0:15129:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff939405a98000) has exports, disconnecting them 00000020:00080000:3.0:1789579039.167774:0:15129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93942ef74800), last request at 1789579037 00000020:00000080:3.0:1789579039.167783:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20be6 00000100:00080000:3.0:1789579039.167804:0:15129:0:(import.c:65:import_set_state_nolock()) ffff9393038d3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789579039.167841:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942ef74800): rc 0 00000020:00000080:3.0:1789579039.167844:0:15129:0:(genops.c:885:class_export_put()) final put ffff93942ef74800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789579039.167860:0:15129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939302080000), last request at 1789579037 00000020:00000080:3.0:1789579039.167863:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ac0 00000100:00080000:3.0:1789579039.167869:0:15129:0:(import.c:65:import_set_state_nolock()) ffff939302084800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789579039.167875:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939302080000): rc 0 00000020:00000080:3.0:1789579039.167877:0:15129:0:(genops.c:885:class_export_put()) final put ffff939302080000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789579039.167881:0:15129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93942ee06800), last request at 1789578807 00000020:00000080:3.0:1789579039.167884:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f209bd 00000100:00080000:3.0:1789579039.167887:0:15129:0:(import.c:65:import_set_state_nolock()) ffff93942ee04800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789579039.167892:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942ee06800): rc 0 00000020:00000080:3.0:1789579039.167894:0:15129:0:(genops.c:885:class_export_put()) final put ffff93942ee06800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789579039.167897:0:15129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93942ee04000), last request at 1789578807 00000020:00000080:3.0:1789579039.167900:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2098c 00000100:00080000:3.0:1789579039.167904:0:15129:0:(import.c:65:import_set_state_nolock()) ffff93942e15d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789579039.167910:0:15129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1789579039.167993:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942ee04000): rc 0 00000004:00000080:3.0:1789579039.168006:0:15129:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd9787a6bae0 00000100:00080000:3.0:1789579039.168029:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579039.168034:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789579039.169075:0:15129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789579039.169116:0:15129:0:(import.c:65:import_set_state_nolock()) ffff9394370c8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789579039.169179:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789579039.169189:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169202:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afc00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579039.169207:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169218:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579039.169224:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579039.169230:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579039.169233:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789579039.169237:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789579039.169279:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169287:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579039.169318:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169327:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363afc00/0xd90373d592f20d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d8a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169406:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789579039.169410:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169416:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579039.169418:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.169425:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579039.169431:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579039.169435:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789579039.169437:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789579039.169439:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789579039.171164:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789579039.171181:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171193:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579039.171197:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171207:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579039.171214:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579039.171220:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789579039.171223:0:9493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789579039.171226:0:9493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789579039.171271:0:9493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171278:0:9493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579039.171294:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171300:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae400/0xd90373d592f20fcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fd6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171318:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579039.171339:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171345:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401686400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579039.171370:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171378:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579039.171384:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579039.171388:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579039.171391:0:9493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789579039.171393:0:9493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789579039.171410:0:9493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171416:0:9493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579039.171438:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171445:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401686400/0xd90373d592f20835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f2083c expref: -99 pid: 6467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.171472:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579039.171473:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579039.171475:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579039.171770:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277185536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579039.171859:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579039.171963:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185536 00000100:00100000:1.0:1789579039.171972:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185536 00000100:00100000:1.0:1789579039.172037:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579039.172049:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3617:x1876509277185536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579039.172065:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579039.172083:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519c00/0xd90373d592f2083c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20835 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.172098:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579039.172137:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3617:x1876509277185536:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579039.172144:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579039.172189:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277185536:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789579039.172491:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef74800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789579039.172551:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302080000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789579039.172575:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ee06800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789579039.172599:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393038d3800 for lustre-MDT0000 00000020:00000080:0.0:1789579039.172606:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302084800 for lustre-MDT0000 00000020:00000080:0.0:1789579039.172609:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942ee04800 for lustre-MDT0000 00010000:00010000:2.0:1789579039.175154:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579039.175168:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579039.175690:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277185408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579039.175788:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579039.175851:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579039.175859:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277185280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579039.175885:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579039.183735:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185280 00000100:00100000:1.0:1789579039.183756:0:6475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185280 00000100:00100000:2.0:1789579039.183902:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185408 00000100:00100000:2.0:1789579039.183910:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185408 00000100:00080000:0.0:1789579039.184050:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789579039.184058:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789579039.184076:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789579039.184147:0:15129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789579039.184178:0:15129:0:(import.c:65:import_set_state_nolock()) ffff939302b55000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789579039.184192:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789579039.184195:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1789579039.184205:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789579039.184265:0:15129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789579039.184274:0:15129:0:(import.c:65:import_set_state_nolock()) ffff939303a24800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789579039.184310:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff939405a98000) has no exports 00000100:00100000:0.0:1789579039.184373:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185152:0@lo:39:umount.0 00000100:00100000:0.0:1789579039.184472:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579039.184515:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185664:0@lo:9:umount.0 00000100:00100000:0.0:1789579039.184567:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579039.184601:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185792:0@lo:9:umount.0 00000100:00100000:0.0:1789579039.184624:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579039.184661:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579039.184731:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185152 00000100:00100000:0.0:1789579039.184737:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185152 00000100:00100000:0.0:1789579039.184778:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789579039.184788:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277185152:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789579039.184835:0:9869:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20a18 00000100:00080000:0.0:1789579039.184846:0:9869:0:(import.c:65:import_set_state_nolock()) ffff93943711d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579039.184872:0:9869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789579039.185022:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3614:x1876509277185152:12345-0@lo:39:umount.0 Request processed in 234us (550us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789579039.185030:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1789579039.185466:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394370c8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789579039.185475:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185152:0@lo:39:umount.0 00000100:00100000:0.0:1789579039.185511:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185664 00000100:00100000:0.0:1789579039.185516:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185664 00000100:00100000:0.0:1789579039.185556:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185792 00000100:00100000:0.0:1789579039.185560:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185792 00000100:00100000:0.0:1789579039.185585:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789579039.185593:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277185664:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789579039.185611:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b68 00000100:00080000:0.0:1789579039.185619:0:8403:0:(import.c:65:import_set_state_nolock()) ffff939302b52000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579039.185669:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789579039.185785:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3614:x1876509277185664:12345-0@lo:9:umount.0 Request processed in 193us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579039.185808:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789579039.185822:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789579039.185828:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876509277185792:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789579039.185842:0:8403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20caa 00000100:00080000:0.0:1789579039.185848:0:8403:0:(import.c:65:import_set_state_nolock()) ffff93942f20e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789579039.185871:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789579039.185949:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3614:x1876509277185792:12345-0@lo:9:umount.0 Request processed in 120us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579039.185957:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789579039.185993:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b55000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789579039.186003:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789579039.186005:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789579039.186008:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185664:0@lo:9:umount.0 00000100:00080000:0.0:1789579039.186020:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939303a24800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789579039.186027:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789579039.186029:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789579039.186031:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930289ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277185792:0@lo:9:umount.0 00000100:00080000:0.0:1789579039.186077:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579039.186081:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789579039.186090:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579039.186206:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579039.186217:0:6475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+23:3616:x1876509277185280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579039.186232:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579039.186260:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36a00/0xd90373d592f20d8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20d83 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579039.186279:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579039.186319:0:6475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3616:x1876509277185280:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (10433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579039.186325:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579039.186385:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277185280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579039.186730:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.186741:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579039.186766:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.186773:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401519200/0xd90373d592f20c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c80 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579039.186796:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277185920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579039.186856:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579039.186924:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277185920 00000100:00100000:3.0:1789579039.186930:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277185920 00010000:00010000:0.0:1789579039.187434:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579039.187442:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579039.190887:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789579039.190919:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+22:3616:x1876509277185408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579039.190947:0:9492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579039.191249:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401518400/0xd90373d592f20fd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20fcf expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579039.191278:0:9492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579039.191416:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42b2619d-9ae6-4775-a880-4d874c1635bc+21:3616:x1876509277185408:12345-0@lo:103:ldlm_bl.0 Request processed in 514us (15628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579039.191424:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789579039.191494:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579039.191498:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579039.191500:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579039.191618:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789579039.191633:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+20:3618:x1876509277185920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579039.191646:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579039.191672:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f600/0xd90373d592f20c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd90373d592f20c79 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579039.191685:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579039.191720:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3618:x1876509277185920:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (4864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579039.191727:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789579039.191776:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:3618:1876509277185920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579039.192056:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394362bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277185408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789579039.223628:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff939405a98000) has no exports 00000020:00000080:1.0:1789579039.268118:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20890 00000020:00000080:1.0:1789579039.268131:0:15129:0:(genops.c:885:class_export_put()) final put ffff939436110000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789579039.268186:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789579039.268283:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579039.268294:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789579039.268298:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9394100899c0) has no exports 00000020:00000080:2.0:1789579039.268389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939436110000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789579039.268670:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20889 00000020:00000080:0.0:1789579039.268691:0:15129:0:(genops.c:885:class_export_put()) final put ffff93940eb0f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789579039.268743:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579039.268750:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789579039.268753:0:15129:0:(genops.c:885:class_export_put()) final put ffff93940eb0c000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789579039.268755:0:15129:0:(genops.c:844:class_export_destroy()) destroying export ffff93940eb0c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789579039.268762:0:15129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789579039.268932:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93940eb0f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:2.0:1789579039.589782:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789579039.589791:0:8398:0:(genops.c:885:class_export_put()) final put ffff939302b51000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789579039.589827:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:2.0:1789579039.589830:0:8398:0:(genops.c:885:class_export_put()) final put ffff93943f581800/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:0.0:1789579039.590032:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b51000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789579039.590099:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f581800/28fc5077-c53d-437a-bade-84c159d25114 for lustre-OST0000 00000020:00000080:0.0:1789579039.590123:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302b52000 for lustre-OST0000 00000020:00000080:0.0:1789579039.590128:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939304137800 for lustre-OST0000 00000001:00100000:1.0:1789579039.603674:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789579039.603684:0:9483:0:(genops.c:885:class_export_put()) final put ffff93930232c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789579039.603713:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:1.0:1789579039.603715:0:9483:0:(genops.c:885:class_export_put()) final put ffff939418b24000/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:2.0:1789579039.603780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93930232c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789579039.603841:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939418b24000/28fc5077-c53d-437a-bade-84c159d25114 for lustre-OST0001 00000020:00000080:2.0:1789579039.603858:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942f20e800 for lustre-OST0001 00000020:00000080:2.0:1789579039.603864:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939418b25000 for lustre-OST0001 00010000:00010000:0.0:1789579039.907707:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789579040.617524:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789579040.617541:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789579040.617546:0:7422:0:(genops.c:885:class_export_put()) final put ffff93942ef73000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789579040.617566:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00080000:0.0:1789579040.617573:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789579040.617575:0:7422:0:(genops.c:885:class_export_put()) final put ffff93943f587800/eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00100000:0.0:1789579040.617581:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 28fc5077-c53d-437a-bade-84c159d25114 00000001:00080000:0.0:1789579040.617585:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789579040.617587:0:7422:0:(genops.c:885:class_export_put()) final put ffff9394371f7800/28fc5077-c53d-437a-bade-84c159d25114 00000020:00000080:2.0:1789579040.618233:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef73000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789579040.618296:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f587800/eb97d94f-5343-4111-9eea-cc9a295afa74 for lustre-MDT0001 00000020:00000080:2.0:1789579040.618322:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9394371f7800/28fc5077-c53d-437a-bade-84c159d25114 for lustre-MDT0001 00000020:00000080:2.0:1789579040.618377:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943711d800 for lustre-MDT0001 00000020:00000080:2.0:1789579040.618382:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f582800 for lustre-MDT0001 00000020:00000080:2.0:1789579040.618386:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9393038d2800 for lustre-MDT0001 00000040:00080000:1.0:1789579040.868230:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579040.931500:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789579041.637043:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579041.637052:0:6469:0:(genops.c:885:class_export_put()) final put ffff93942ee04000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789579041.637162:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ee04000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789579041.637222:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942e15d000 for lustre-MDT0000 00000001:00100000:1.0:1789579041.637330:0:6469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb97d94f-5343-4111-9eea-cc9a295afa74 00000001:00080000:1.0:1789579041.637338:0:6469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789579041.637341:0:6469:0:(genops.c:885:class_export_put()) final put ffff93943f584000/eb97d94f-5343-4111-9eea-cc9a295afa74 00000020:00000080:0.0:1789579041.637790:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f584000/eb97d94f-5343-4111-9eea-cc9a295afa74 for lustre-MDT0000 00000020:00000080:0.0:1789579041.637827:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f586000 for lustre-MDT0000 00010000:00010000:0.0:1789579041.955567:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579042.147867:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277186048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579042.147934:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579042.148226:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186048 00000100:00100000:1.0:1789579042.148234:0:8407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186048 00000100:00100000:1.0:1789579042.148289:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789579042.148299:0:8407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277186048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789579042.148325:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789579042.148393:0:8407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277186048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579042.148401:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789579042.148450:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277186048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579042.148714:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277186176:0@lo:400:kworker.0 00000100:00100000:2.0:1789579042.148746:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579042.148768:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277186688:0@lo:400:kworker.0 00000100:00100000:2.0:1789579042.148791:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579042.148810:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789579042.148816:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277186560:0@lo:400:kworker.0 00000100:00100000:2.0:1789579042.148839:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579042.148853:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277187072:0@lo:400:kworker.0 00000100:00100000:2.0:1789579042.148870:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579042.149099:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186688 00000100:00100000:1.0:1789579042.149104:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186688 00000100:00100000:1.0:1789579042.149140:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186560 00000100:00100000:1.0:1789579042.149144:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186560 00000100:00100000:1.0:1789579042.149161:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187072 00000100:00100000:1.0:1789579042.149163:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187072 00000100:00100000:1.0:1789579042.149178:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789579042.149197:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277186688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579042.149233:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277186688:12345-0@lo:400:kworker.0 Request processed in 37us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579042.149240:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789579042.149252:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789579042.149257:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277187072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579042.149282:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876509277187072:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579042.149288:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789579042.149300:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789579042.149305:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1876509277186560:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789579042.149310:0:13782:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789579042.149335:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1876509277186560:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789579042.149341:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789579042.149773:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277186304:0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.149812:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579042.149834:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277186816:0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.149857:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579042.149877:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789579042.149883:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277186432:0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.149902:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579042.149917:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277186944:0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.149936:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579042.149969:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186176 00000100:00100000:3.0:1789579042.149973:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186176 00000100:00100000:3.0:1789579042.150001:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789579042.150008:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3616:x1876509277186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.150051:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939405ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42b2619d-9ae6-4775-a880-4d874c1635bc+19:3616:x1876509277186176:12345-0@lo:400:kworker.0 Request processed in 43us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579042.150056:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789579042.150307:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186304 00000100:00100000:3.0:1789579042.150312:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186304 00000100:00100000:3.0:1789579042.150334:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789579042.150338:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876509277186304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789579042.150343:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789579042.150397:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1876509277186304:12345-0@lo:400:kworker.0 Request processed in 58us (586us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789579042.150404:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789579042.150420:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186816 00000100:00100000:3.0:1789579042.150434:0:8403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186816 00000100:00100000:3.0:1789579042.150462:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789579042.150469:0:8403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277186816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.150498:0:8403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277186816:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579042.150503:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789579042.150519:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186432 00000100:00100000:3.0:1789579042.150522:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186432 00000100:00100000:3.0:1789579042.150539:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277186944 00000100:00100000:3.0:1789579042.150542:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277186944 00000100:00100000:3.0:1789579042.150555:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789579042.150559:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277186432:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789579042.150564:0:6490:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789579042.150586:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277186432:12345-0@lo:400:kworker.0 Request processed in 26us (682us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789579042.150591:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789579042.150610:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789579042.150613:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277186944:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789579042.150618:0:6490:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789579042.150639:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1876509277186944:12345-0@lo:400:kworker.0 Request processed in 24us (703us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789579042.150644:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1789579042.150745:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789579042.150750:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789579042.150754:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789579042.150891:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789579042.150896:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789579042.150898:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579042.150934:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579042.150944:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277187200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579042.150984:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579042.151011:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187200 00000100:00100000:0.0:1789579042.151015:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187200 00000100:00100000:0.0:1789579042.151037:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789579042.151043:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277187200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579042.151063:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789579042.151106:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277187200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579042.151112:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789579042.151143:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277187200:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789579042.151294:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789579042.151303:0:3616:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789579042.151307:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789579042.151312:0:3616:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579042.151315:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 182 00000100:00080000:2.0:1789579042.151324:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93942e144800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579042.151377:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5ce00 x1876509277187328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579042.151399:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277186560:0@lo:400:kworker.0 00010000:00080000:2.0:1789579042.151413:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5ea00 x1876509277187072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579042.151422:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876509277187072:0@lo:400:kworker.0 00000100:00100000:2.0:1789579042.151440:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:3616:1876509277186176:0@lo:400:kworker.0 00010000:00080000:2.0:1789579042.151449:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5f800 x1876509277186688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579042.151458:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277186688:0@lo:400:kworker.0 00000100:00100000:0.0:1789579042.152027:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277187328:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789579042.152062:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579042.152187:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187328 00000100:00100000:1.0:1789579042.152192:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187328 00000100:00100000:1.0:1789579042.152224:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789579042.152230:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277187328:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789579042.152243:0:6490:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789579042.178492:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277187328:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26255us (26423us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579042.178505:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1789579042.178685:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579042.178690:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579042.178694:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277187328:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1789579042.181795:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579042.181816:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 162 00000100:00080000:3.0:1789579042.181831:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93942ef77000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579042.181872:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489ed80 x1876509277187456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579042.181909:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277186432:0@lo:400:kworker.0 00000100:00080000:3.0:1789579042.181948:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789579042.181958:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789579042.181962:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789579042.181966:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579042.181969:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 202 00000100:00080000:3.0:1789579042.181974:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93930232d000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579042.181986:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489c380 x1876509277187584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579042.181997:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277186944:0@lo:400:kworker.0 00000100:00080000:3.0:1789579042.182025:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789579042.182028:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789579042.182031:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789579042.182036:0:3617:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579042.182039:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 162 00000100:00080000:3.0:1789579042.182043:0:3617:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93942ee05800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579042.182056:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489f100 x1876509277187712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579042.182066:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277186304:0@lo:400:kworker.0 00000100:00100000:3.0:1789579042.182191:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277186816:0@lo:400:kworker.0 00000100:00100000:0.0:1789579042.183930:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277187456:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789579042.184003:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579042.184048:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277187584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789579042.184062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187456 00000100:00100000:0.0:1789579042.184072:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579042.184096:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277187712:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789579042.184121:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579042.184157:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187712 00000100:00100000:1.0:1789579042.184159:0:13782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187584 00000100:00100000:1.0:1789579042.184163:0:13782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187584 00000100:00100000:0.0:1789579042.184163:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187712 00000100:00100000:1.0:1789579042.184197:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789579042.184197:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789579042.184203:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277187712:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789579042.184204:0:13782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3614:x1876509277187584:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789579042.184232:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187456 00000100:00100000:3.0:1789579042.184254:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789579042.184259:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277187456:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789579042.184310:0:13782:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1789579042.184544:0:6491:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1789579042.184551:0:6496:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789579042.184648:0:13782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3614:x1876509277187584:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 443us (573us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579042.184648:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277187712:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 442us (525us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579042.184655:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789579042.184656:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789579042.184975:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579042.184981:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789579042.184985:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277187584:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789579042.184994:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579042.184996:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789579042.184999:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277187712:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789579042.189097:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930289fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277187456:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4827us (5084us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789579042.189110:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789579042.189666:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579042.189674:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789579042.189678:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277187456:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1789579042.979670:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579044.005324:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579045.027703:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789579045.347960:0:15129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93930375b240 - data ffff939429ca8e58/ffff939302baa400 00000020:01000000:0.0:1789579045.348264:0:15129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939429174ae0 - data ffff939429d6aaf8/ffff93940f41f800 00000001:00000004:0.0:1789579045.361775:0:15129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789579045.438299:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789579045.438309:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789579045.438324:0:15129:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93930489ca80 x1876509277185152/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789579049 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579045.438346:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789579045.450293:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789579045.450303:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789579045.450327:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789579045.450330:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789579045.450934:0:8662:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789579045.450939:0:8662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789579045.450950:0:8662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789579045.452942:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579045.452950:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789579045.452969:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579045.452971:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789579045.455839:0:10023:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789579045.455847:0:10023:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789579045.455873:0:10023:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789579045.459445:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20858 00000020:00000080:2.0:1789579045.459466:0:15129:0:(genops.c:885:class_export_put()) final put ffff9394091e9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789579045.459722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9394091e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789579045.465339:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2086d 00000020:00000080:2.0:1789579045.465383:0:15129:0:(genops.c:885:class_export_put()) final put ffff93940f429000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789579045.465397:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789579045.465418:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579045.465426:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579045.465430:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9394071a0000) has no exports 00000004:01000000:2.0:1789579045.465735:0:15129:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789579045.465743:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ca3 00000020:00000080:2.0:1789579045.465748:0:15129:0:(genops.c:885:class_export_put()) final put ffff939302328000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789579045.465753:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789579045.465757:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579045.465766:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579045.465769:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff93943f543380) has no exports 00000020:00000080:2.0:1789579045.465775:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20c9c 00000020:00000080:2.0:1789579045.465778:0:15129:0:(genops.c:885:class_export_put()) final put ffff939303a25000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789579045.466327:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f429000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789579045.466337:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302328000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789579045.466341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a25000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789579045.467177:0:15129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789579045.467183:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579045.467187:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789579045.467193:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579045.467195:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579045.467273:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579045.467285:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789579045.467292:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b61 00000020:00000080:2.0:1789579045.467299:0:15129:0:(genops.c:885:class_export_put()) final put ffff939302b53000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789579045.469429:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939303a24800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789579045.469464:0:36:0:(genops.c:885:class_export_put()) final put ffff93943f583000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789579045.469468:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f583000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789579045.469475:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789579045.469571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789579045.469584:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789579045.469594:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579045.469607:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579045.469612:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9393020d99c0) has no exports 00000020:00000080:2.0:1789579045.469620:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b5a 00000020:00000080:2.0:1789579045.469627:0:15129:0:(genops.c:885:class_export_put()) final put ffff939302b56800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789579045.469657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b56800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789579045.472539:0:15129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789579045.472568:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789579045.472573:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1789579045.472581:0:15129:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579045.472584:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579045.472642:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579045.472660:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789579045.472675:0:15129:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789579045.472682:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20a11 00000020:00000080:2.0:1789579045.472690:0:15129:0:(genops.c:885:class_export_put()) final put ffff93942e15c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789579045.472696:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789579045.472700:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579045.472705:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579045.472708:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93942edfb380) has no exports 00000020:00000080:2.0:1789579045.472715:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20a0a 00000020:00000080:2.0:1789579045.472719:0:15129:0:(genops.c:885:class_export_put()) final put ffff9394370ce000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789579045.472790:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302b55000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789579045.472798:0:14907:0:(genops.c:885:class_export_put()) final put ffff939302b38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789579045.472801:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b38800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789579045.472817:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579045.472897:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e15c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789579045.472903:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9394370ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789579045.475538:0:15129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789579045.475547:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579045.475551:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789579045.475559:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579045.475656:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579045.475670:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579045.475698:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579045.475712:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579045.475718:0:15129:0:(genops.c:885:class_export_put()) final put ffff93942a0b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789579045.475726:0:15129:0:(genops.c:844:class_export_destroy()) destroying export ffff93942a0b0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789579045.475732:0:15129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789579045.475933:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20874 00000020:00000080:3.0:1789579045.475940:0:15129:0:(genops.c:885:class_export_put()) final put ffff93940f42a000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789579045.475959:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9394370c8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789579045.475966:0:14907:0:(genops.c:885:class_export_put()) final put ffff9394370cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789579045.475968:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff9394370cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789579045.475973:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789579045.476445:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789579045.476451:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579045.476465:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789579045.476472:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff939405a9b380) has no exports 00000020:00000080:3.0:1789579045.476518:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579045.476526:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789579045.476531:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2087b 00000020:00000080:3.0:1789579045.476535:0:15129:0:(genops.c:885:class_export_put()) final put ffff93940f428800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789579045.476543:0:15129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940679b000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789579045.476547:0:15129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940679b000 3 00000020:01000004:3.0:1789579045.476549:0:15129:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93940679b000 from lustre-MDT0000 00000020:00000080:3.0:1789579045.476568:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579045.476572:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789579045.476575:0:15129:0:(genops.c:885:class_export_put()) final put ffff9394091ec000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789579045.476587:0:15129:0:(genops.c:844:class_export_destroy()) destroying export ffff9394091ec000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789579045.476595:0:15129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789579045.476629:0:15129:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789579045.476632:0:15129:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789579045.476635:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789579045.476638:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579045.476640:0:15129:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789579045.476646:0:15129:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9394291a2000 42b2619d-9ae6-4775-a880-4d874c1635bc 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579045.476652:0:15129:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff939405a9cd40) has exports, disconnecting them 00000020:00080000:3.0:1789579045.476656:0:15129:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9394291a2000), last request at 1789578787 00000020:00000080:3.0:1789579045.476669:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20819 00000020:00010000:3.0:1789579045.476674:0:15129:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9394291a2000: total 2 00000100:00080000:3.0:1789579045.476678:0:15129:0:(import.c:65:import_set_state_nolock()) ffff9394291a1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789579045.476694:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9394291a2000): rc 0 00000020:00080000:3.0:1789579045.476708:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff939405a9cd40) has no exports 00000020:00000080:1.0:1789579045.476742:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f42a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789579045.476747:0:14907:0:(genops.c:885:class_export_put()) final put ffff93940ebdf800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789579045.476748:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940ebdf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789579045.476752:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:3.0:1789579045.476912:0:6484:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff939441951600:6484] 1 exiting: rc = 0 00000100:00100000:3.0:1789579045.477018:0:6482:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff939405a31a00:6482] 0 exiting: rc = 1 00000020:00000080:1.0:1789579045.477175:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940f428800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789579045.477204:0:6485:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff939441951400:6485] 2 exiting: rc = 0 00000100:00100000:3.0:1789579045.477343:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477376:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477383:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477389:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477396:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477413:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477419:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477424:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477432:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477438:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477445:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477452:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477458:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477463:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477469:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477484:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477490:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477496:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477502:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477507:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477514:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477520:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477527:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477533:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477539:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477545:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477551:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477558:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477564:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477570:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477575:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477581:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477586:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477591:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477596:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477602:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477607:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477612:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477617:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477622:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477628:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477633:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477639:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477645:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477650:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477656:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477662:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477668:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477674:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477679:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477692:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477709:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477716:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477722:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477727:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477733:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477738:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477743:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477750:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477871:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477882:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477888:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477894:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579045.477899:0:15129:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789579045.478851:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394421c7600/0xd90373d592f20915 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f2090e expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478875:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7600/0xd90373d592f20915 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f2090e expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478891:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939302b2e400/0xd90373d592f20d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d21 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478901:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2e400/0xd90373d592f20d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d21 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478910:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939302b2fc00/0xd90373d592f20d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d2f expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478920:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2fc00/0xd90373d592f20d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d2f expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478928:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939302b2f400/0xd90373d592f20d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d3d expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478947:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f400/0xd90373d592f20d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d3d expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478957:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303a36200/0xd90373d592f20d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d4b expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478964:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36200/0xd90373d592f20d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d4b expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478972:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394363afa00/0xd90373d592f20d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d59 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478981:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363afa00/0xd90373d592f20d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d59 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478990:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303a36400/0xd90373d592f20d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d67 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.478998:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36400/0xd90373d592f20d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d67 expref: 8 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479006:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303a36000/0xd90373d592f20d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20d91 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479081:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a36000/0xd90373d592f20d98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20d91 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479093:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939401519e00/0xd90373d592f20c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20c33 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479113:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939401519e00/0xd90373d592f20c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20c33 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479125:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9394421c7e00/0xd90373d592f20923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f2091c expref: 5 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479133:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7e00/0xd90373d592f20923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f2091c expref: 5 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479143:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303a37200/0xd90373d592f20fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20fa5 expref: 4 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479151:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303a37200/0xd90373d592f20fac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20fa5 expref: 4 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479159:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303436000/0xd90373d592f20fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20fb3 expref: 3 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479166:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436000/0xd90373d592f20fba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20fb3 expref: 3 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479174:0:15129:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff939303437600/0xd90373d592f20fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xd90373d592f20fc1 expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579045.479182:0:15129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437600/0xd90373d592f20fc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xd90373d592f20fc1 expref: 2 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1789579045.479285:0:9493:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9394291a2000: total 0 00010000:00010000:0.0:1789579045.479290:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579045.479339:0:9493:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9394291a2000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789579045.479548:0:9493:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9394291a2000, canceled 0 locks, left on hash table 0. 00000020:00000080:0.0:1789579045.479561:0:9493:0:(genops.c:885:class_export_put()) final put ffff9394291a2000/42b2619d-9ae6-4775-a880-4d874c1635bc 00010000:00010000:0.0:1789579045.479576:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579045.479578:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579045.479580:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789579045.480031:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9394291a2000/42b2619d-9ae6-4775-a880-4d874c1635bc for MGS 00000020:00000080:1.0:1789579045.480064:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9394291a1000 for MGS 00010000:00010000:0.0:1789579046.051471:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579047.075606:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579047.268553:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277187840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579047.268577:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579047.268589:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277188096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579047.268622:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579047.268630:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277187968:0@lo:400:kworker.0 00000400:00000100:2.0:1789579047.268644:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277187968 offset 0 length 224: 4 00000100:00100000:2.0:1789579047.268721:0:8664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277187840 00000100:00100000:2.0:1789579047.268728:0:8664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277187840 00000100:00100000:0.0:1789579047.268788:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579047.268816:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188096 00000100:00100000:0.0:1789579047.268820:0:8406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188096 00000100:00100000:0.0:1789579047.268869:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789579047.268876:0:8406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277188096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579047.268899:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789579047.269091:0:8406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277188096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 214us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579047.269107:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1789579047.269129:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579047.269163:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277188096:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789579047.269653:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579047.269659:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579047.269663:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579047.269668:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789579047.269672:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579047.269679:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93942ee05800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579047.269705:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439ad80 x1876509277188224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579047.269732:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579047.269744:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579047.269746:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579047.269750:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789579047.269753:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579047.269759:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93942ef77000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579047.269885:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304398a80 x1876509277188352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579047.269896:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579047.269899:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579047.269900:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579047.269903:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789579047.269906:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579047.269912:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93942e144800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579047.269924:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304398380 x1876509277188480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579047.269956:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579047.269960:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579047.269961:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579047.269964:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:1.0:1789579047.269967:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579047.269971:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93930232d000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579047.269982:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304399880 x1876509277188736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579047.270030:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277188608:0@lo:400:kworker.0 00000100:00100000:1.0:1789579047.270032:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579047.270048:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277188864:0@lo:400:kworker.0 00000100:00100000:3.0:1789579047.270088:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579047.270118:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188608 00000100:00100000:1.0:1789579047.270123:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188608 00000100:00100000:1.0:1789579047.270165:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00080000:3.0:1789579047.270168:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579047.270173:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277188608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579047.270215:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277188608:12345-0@lo:400:kworker.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579047.270222:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:3.0:1789579047.270234:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930439aa00 x1876509277188608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579047.270246:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277188608:0@lo:400:kworker.0 00000100:00100000:1.0:1789579047.270282:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579047.270370:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277188224:0@lo:38:kworker.0 00000100:00100000:0.0:1789579047.270410:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579047.270437:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277188352:0@lo:38:kworker.0 00000100:00100000:3.0:1789579047.270438:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188864 00000100:00100000:3.0:1789579047.270445:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188864 00000100:00100000:1.0:1789579047.270457:0:9869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188224 00000100:00100000:1.0:1789579047.270463:0:9869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188224 00000100:00100000:0.0:1789579047.270477:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579047.270489:0:9869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789579047.270495:0:9869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876509277188224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789579047.270513:0:9869:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789579047.270545:0:9869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1876509277188224:12345-0@lo:38:kworker.0 Request processed in 49us (134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579047.270551:0:9869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789579047.270610:0:8664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789579047.270618:0:8664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277187840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579047.270638:0:8664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789579047.270676:0:8664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277187840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579047.270683:0:8664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789579047.270717:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277187840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789579047.270863:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579047.270866:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789579047.271460:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188352 00000100:00100000:3.0:1789579047.271471:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188352 00000100:00100000:0.0:1789579047.271481:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277188480:0@lo:38:kworker.0 00000100:00100000:3.0:1789579047.271505:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789579047.271508:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579047.271519:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277188864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579047.271524:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277188736:0@lo:38:kworker.0 00000100:00100000:0.0:1789579047.271540:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789579047.271563:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579047.271567:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579047.271569:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277188224:0@lo:38:kworker.0 00000100:00100000:0.0:1789579047.271630:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188480 00000100:00100000:0.0:1789579047.271633:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188480 00000100:00100000:0.0:1789579047.271642:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188736 00000100:00100000:0.0:1789579047.271644:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188736 00000100:00100000:0.0:1789579047.271650:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789579047.271652:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789579047.271663:0:6490:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789579047.271875:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188352:12345-0@lo:38:kworker.0 Request processed in 221us (1399us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579047.271881:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789579047.271898:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789579047.271900:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789579047.271908:0:6490:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789579047.271920:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277188864:12345-0@lo:400:kworker.0 Request processed in 403us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579047.271927:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188480:12345-0@lo:38:kworker.0 Request processed in 24us (420us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579047.271932:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789579047.271938:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789579047.271956:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789579047.271958:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789579047.271963:0:6490:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789579047.271974:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277188736:12345-0@lo:38:kworker.0 Request processed in 15us (433us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789579047.272056:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1789579047.272078:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579047.272081:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579047.272083:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277188352:0@lo:38:kworker.0 00000100:00080000:0.0:1789579047.272088:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579047.272090:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579047.272092:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277188480:0@lo:38:kworker.0 00000100:00080000:0.0:1789579047.272095:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579047.272097:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579047.272099:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277188736:0@lo:38:kworker.0 00010000:00080000:2.0:1789579047.272445:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304398000 x1876509277188864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579047.272457:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277188864:0@lo:400:kworker.0 00000020:01000000:3.0:1789579047.524767:0:15129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93930375bc60 - data ffff939429eabd80/ffff9393038c9c00 00000020:01000000:3.0:1789579047.524923:0:15129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9394062ca5a0 - data ffff939429cbfbd0/ffff939410009c00 00000020:00000080:3.0:1789579047.526818:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f207fd 00000020:00000080:3.0:1789579047.526831:0:15129:0:(genops.c:885:class_export_put()) final put ffff939432173800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789579047.526858:0:15129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940679b000 from MGS, refs=2 00000020:01000004:3.0:1789579047.526862:0:15129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940679b000 2 00000020:01000004:3.0:1789579047.526865:0:15129:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93940679b000 from MGS 00000020:00000080:3.0:1789579047.526890:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579047.526897:0:15129:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789579047.526899:0:15129:0:(genops.c:885:class_export_put()) final put ffff939432175000/MGS 00000020:00000080:3.0:1789579047.526902:0:15129:0:(genops.c:844:class_export_destroy()) destroying export ffff939432175000/MGS for MGS 00000020:01000000:3.0:1789579047.526908:0:15129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789579047.526964:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789579047.526968:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579047.526987:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789579047.526993:0:15129:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff939436232000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789579047.527001:0:15129:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff939436158000) has exports, disconnecting them 00000020:00080000:3.0:1789579047.527006:0:15129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff939436232000), last request at 1789578788 00000020:00000080:3.0:1789579047.527010:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f208c8 00000020:00080000:3.0:1789579047.527019:0:15129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939436232000): rc 0 00000020:00000080:3.0:1789579047.527023:0:15129:0:(genops.c:885:class_export_put()) final put ffff939436232000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789579047.530984:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939432173800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789579047.531005:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939436232000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789579047.531033:0:15129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789579047.531036:0:15129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579047.531040:0:15129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789579047.531046:0:15129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579047.531208:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579047.531217:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789579047.531224:0:15129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940679b000 1 00000020:00000080:2.0:1789579047.531231:0:15129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f207ef 00000020:00000080:2.0:1789579047.531239:0:15129:0:(genops.c:885:class_export_put()) final put ffff939432176800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789579047.531244:0:15129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789579047.531249:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579047.531254:0:15129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579047.531258:0:15129:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff939405a999c0) has no exports 00000020:00000080:0.0:1789579047.531269:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939436230000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789579047.531286:0:14907:0:(genops.c:885:class_export_put()) final put ffff93940ebda800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789579047.531288:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff93940ebda800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789579047.531313:0:14907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789579047.531451:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939432176800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789579047.581249:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579047.581263:0:15129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789579047.581269:0:15129:0:(genops.c:885:class_export_put()) final put ffff93943806e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789579047.581274:0:15129:0:(genops.c:844:class_export_destroy()) destroying export ffff93943806e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789579047.581283:0:15129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789579047.581428:0:15129:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939402ade800 00000020:02000400:1.0:1789579047.581493:0:15129:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789579048.101967:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579049.133777:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579050.084839:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579050.147629:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789579050.622607:0:15332:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789579050.640271:0:15332:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789579050.640321:0:15332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.640337:0:15332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.640345:0:15332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.640535:0:15332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.640593:0:15332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789579050.640600:0:15332:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789579050.640629:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579050.640633:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789579050.640688:0:15332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579050.640695:0:15332:0:(import.c:65:import_set_state_nolock()) ffff93942ef77000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789579050.640700:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579050.640702:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579050.640706:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789579050.641773:0:15332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.641785:0:15332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.641793:0:15332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.641800:0:15332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.641864:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579050.641871:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.641879:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579050.641883:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.641891:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579050.641898:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579050.641904:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789579050.641907:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789579050.641909:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789579050.641940:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.641947:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579050.641979:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.641987:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303a37800/0xd90373d592f20d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d60 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.642015:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579050.642018:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.642024:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afe00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579050.642027:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.642034:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579050.642041:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579050.642046:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789579050.642048:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789579050.642061:0:6478:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.642067:0:6478:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579050.642083:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579050.642090:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579050.642092:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579050.642094:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579050.642114:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277189120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579050.642173:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579050.642236:0:9492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277189120 00000100:00100000:0.0:1789579050.642248:0:9492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277189120 00000100:00100000:0.0:1789579050.642283:0:9492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789579050.642290:0:9492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3615:x1876509277189120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789579050.642296:0:9492:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579050 with bad export cookie 15637469692291057689 00000100:00100000:3.0:1789579050.642765:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579050.642775:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277188992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579050.642808:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579050.642840:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277188992 00000100:00100000:3.0:1789579050.642844:0:6476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277188992 00000100:00100000:3.0:1789579050.642867:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579050.642872:0:6476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1876509277188992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789579050.642876:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789579050 with bad export cookie 15637469692291057689 00000100:00100000:3.0:1789579050.642916:0:6476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1876509277188992:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (106us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789579050.642923:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789579050.642958:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789579050.642962:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939402adc000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789579050.642965:0:3617:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789579050.643986:0:15332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789579050.643995:0:15332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363afe00/0xd90373d592f20d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20d6e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644028:0:15332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644036:0:15332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644043:0:15332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644049:0:15332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.644080:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579050.644087:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.644099:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579050.644103:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.644110:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579050.644116:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579050.644121:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579050.644124:0:10313:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789579050.644172:0:15332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1789579050.644176:0:15332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789579050.644185:0:15332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644192:0:15332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644198:0:15332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644204:0:15332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644217:0:15332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579050.644228:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579050.644232:0:10312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644244:0:10312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579050.644247:0:10312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.644254:0:10312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579050.644260:0:10312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579050.644266:0:10312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789579050.644268:0:10312:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789579050.644270:0:10312:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:3.0:1789579050.661013:0:3617:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.137@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789579050.661019:0:3617:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789579050.661029:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939304399f80 x1876509277187968/t0(0) o400->MGC192.168.203.137@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789579063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579050.661043:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939303a30e00 x1876509277189120/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579066 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579050.661089:0:3617:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939303a32a00 x1876509277188992/t0(0) o103->MGC192.168.203.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789579066 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789579050.661104:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789579050.661107:0:3617:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789579050.661108:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1789579050.661617:0:10313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.661629:0:10313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1789579050.662288:0:3617:0:(import.c:65:import_set_state_nolock()) ffff939402adc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579050.662295:0:3617:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:3.0:1789579050.662309:0:3617:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939402adc000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579050.662346:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42b2619d-9ae6-4775-a880-4d874c1635bc:3615:1876509277189120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579050.662659:0:3617:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489c380 x1876509277189376/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579050.662692:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277189376:0@lo:250:ptlrpcd_00_02.0 00010000:00010000:1.0:1789579050.662717:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.662728:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae600/0xd90373d592f20c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20c3a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579050.662750:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579050.662753:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579050.662756:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.662858:0:10312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.662867:0:10312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789579050.663054:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789579050.663084:0:10312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663093:0:10312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303a37e00/0xd90373d592f20fc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd90373d592f20fc8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663104:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.663106:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.663107:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.663121:0:15332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663130:0:15332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663147:0:15332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663154:0:15332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.663171:0:15332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789579050.663176:0:15332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789579050.663180:0:15332:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789579050.663213:0:15332:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789579050.663217:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789579050.663221:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579050.663227:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789579050.663232:0:15332:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff939441aa1800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579050.663237:0:15332:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff939302087800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579050.663242:0:15332:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff93943615cd40) has exports, disconnecting them 00000020:00080000:2.0:1789579050.663246:0:15332:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff939441aa1800), last request at 1789579047 00000020:00000080:2.0:1789579050.663253:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20bfb 00000100:00080000:2.0:1789579050.663268:0:15332:0:(import.c:65:import_set_state_nolock()) ffff939441aa0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789579050.663308:0:15332:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939441aa1800): rc 0 00000020:00000080:2.0:1789579050.663310:0:15332:0:(genops.c:885:class_export_put()) final put ffff939441aa1800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789579050.663320:0:15332:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff939302087800), last request at 1789579047 00000020:00000080:2.0:1789579050.663324:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ad5 00000100:00080000:2.0:1789579050.663329:0:15332:0:(import.c:65:import_set_state_nolock()) ffff939302083800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789579050.663339:0:15332:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939302087800): rc 0 00000020:00000080:2.0:1789579050.663340:0:15332:0:(genops.c:885:class_export_put()) final put ffff939302087800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789579050.663472:0:15332:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbd9781ce7ae0 00000100:00080000:2.0:1789579050.663495:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579050.663498:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000400:00000100:3.0:1789579050.663987:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277189376 offset 0 length 520: 4 00000100:00100000:3.0:1789579050.664043:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42b2619d-9ae6-4775-a880-4d874c1635bc:0:1876509277189248:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789579050.664065:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939441aa1800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789579050.664111:0:14907:0:(genops.c:844:class_export_destroy()) destroying export ffff939302087800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789579050.664126:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939441aa0000 for lustre-MDT0001 00000020:00000080:3.0:1789579050.664130:0:14907:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939302083800 for lustre-MDT0001 00000100:00100000:3.0:1789579050.664168:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277187968:0@lo:400:kworker.0 00000100:00100000:3.0:1789579050.664181:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42b2619d-9ae6-4775-a880-4d874c1635bc:3617:1876509277188992:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789579050.664316:0:15332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789579050.664321:0:15332:0:(import.c:65:import_set_state_nolock()) ffff93942ee05800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789579050.664403:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579050.664410:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.664419:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c7a00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579050.664423:0:6478:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.664432:0:6478:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579050.664434:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42b2619d-9ae6-4775-a880-4d874c1635bc:0:1876509277189504:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789579050.664447:0:6478:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579050.664452:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789579050.664452:0:6478:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1789579050.664455:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789579050.664457:0:6478:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1789579050.664460:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789579050.664461:0:6478:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789579050.664473:0:6478:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:2.0:1789579050.664476:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.664482:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2091c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20923 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579050.664501:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.664502:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579050.664511:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789579050.664527:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789579050.664531:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789579050.664552:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789579050.664611:0:15332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789579050.664628:0:15332:0:(import.c:65:import_set_state_nolock()) ffff93930232c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789579050.664656:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789579050.664659:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789579050.664672:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.664678:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277189632:0@lo:9:umount.0 00000100:00100000:2.0:1789579050.664719:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789579050.664738:0:15332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789579050.664749:0:15332:0:(import.c:65:import_set_state_nolock()) ffff93943f587000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789579050.664756:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277189632 00000100:00100000:2.0:1789579050.664762:0:8404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277189632 00000100:00100000:2.0:1789579050.664804:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789579050.664813:0:8404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1876509277189632:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789579050.664835:0:8404:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b22 00000020:00080000:3.0:1789579050.664840:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93943615cd40) has no exports 00000100:00080000:2.0:1789579050.664842:0:8404:0:(import.c:65:import_set_state_nolock()) ffff93942e143000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789579050.664874:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1789579050.664876:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789579050.664889:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277189760:0@lo:9:umount.0 00000100:00100000:3.0:1789579050.664920:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579050.664957:0:10029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277189760 00000100:00100000:1.0:1789579050.664978:0:10029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277189760 00000100:00100000:2.0:1789579050.665002:0:8404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3614:x1876509277189632:12345-0@lo:9:umount.0 Request processed in 189us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579050.665009:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789579050.665016:0:10029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789579050.665024:0:10029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1876509277189760:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789579050.665037:0:10029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20c64 00000100:00080000:2.0:1789579050.665045:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93930232c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789579050.665045:0:10029:0:(import.c:65:import_set_state_nolock()) ffff93943f582000 : changing import state from FULL to CLOSED 00000004:00080000:2.0:1789579050.665057:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579050.665059:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.665061:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277189632:0@lo:9:umount.0 00010000:00010000:3.0:1789579050.665064:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789579050.665080:0:10029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789579050.665187:0:10029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3614:x1876509277189760:12345-0@lo:9:umount.0 Request processed in 163us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579050.665193:0:10029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789579050.665204:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93943f587000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789579050.665212:0:6486:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789579050.665220:0:3614:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789579050.665224:0:3614:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1789579050.665225:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579050.665226:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277189760:0@lo:9:umount.0 00000400:00000100:1.0:1789579050.668460:0:9492:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876509277189120 offset 224 length 224: 4 00000100:00100000:1.0:1789579050.668485:0:9492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3615:x1876509277189120:12345-0@lo:103:ldlm_bl.0 Request processed in 26192us (26310us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789579050.668497:0:9492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:3.0:1789579050.672699:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93943615cd40) has no exports 00000020:01000000:2.0:1789579050.700198:0:15332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9393037d5180 - data ffff939429de6438/ffff93943732c800 00000020:01000000:2.0:1789579050.700530:0:15332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939429174ba0 - data ffff939429d746c0/ffff93942edc4c00 00000001:00000004:2.0:1789579050.711512:0:15332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789579050.750742:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579050.750750:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789579050.750758:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789579050.756248:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789579050.756267:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789579050.756290:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.756294:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789579050.756734:0:8648:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789579050.756740:0:8648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789579050.756750:0:8648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789579050.757748:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579050.757754:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789579050.757774:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.757777:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789579050.760272:0:10018:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789579050.760279:0:10018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789579050.760292:0:10018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789579050.762255:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2093f 00000020:00000080:2.0:1789579050.762267:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e144000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789579050.765323:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20954 00000020:00000080:2.0:1789579050.765335:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e15c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789579050.765341:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789579050.765346:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579050.765429:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789579050.765434:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9394361599c0) has no exports 00000004:01000000:2.0:1789579050.765595:0:15332:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789579050.765613:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20c5d 00000020:00000080:2.0:1789579050.765618:0:15332:0:(genops.c:885:class_export_put()) final put ffff93943f585800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789579050.765622:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789579050.765625:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579050.765632:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579050.765634:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff93943f540000) has no exports 00000020:00000080:2.0:1789579050.765639:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20c56 00000020:00000080:2.0:1789579050.765643:0:15332:0:(genops.c:885:class_export_put()) final put ffff93943f585000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789579050.765983:0:15332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789579050.765988:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789579050.765992:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789579050.765997:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.765999:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579050.766029:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579050.766036:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789579050.766040:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b1b 00000020:00000080:2.0:1789579050.766064:0:15332:0:(genops.c:885:class_export_put()) final put ffff939302084000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789579050.766068:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789579050.766072:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579050.766076:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579050.766079:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9393020db380) has no exports 00000020:00000080:2.0:1789579050.766083:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b14 00000020:00000080:2.0:1789579050.766085:0:15332:0:(genops.c:885:class_export_put()) final put ffff93930232f800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789579050.766442:0:15332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789579050.766445:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789579050.766448:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789579050.766452:0:15332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789579050.766453:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789579050.766482:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579050.766492:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789579050.766502:0:15332:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789579050.766508:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20977 00000020:00000080:2.0:1789579050.766512:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942ef72800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789579050.766517:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789579050.766520:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579050.766523:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579050.766525:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93942edf8000) has no exports 00000020:00000080:2.0:1789579050.766529:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20970 00000020:00000080:2.0:1789579050.766532:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942ee06000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789579050.767398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e144000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789579050.767409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e15c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789579050.767413:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f585800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789579050.767417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f585000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789579050.767422:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f587000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789579050.767429:0:8:0:(genops.c:885:class_export_put()) final put ffff939303a20000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579050.767431:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939303a20000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789579050.767435:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579050.767505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939302084000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789579050.767509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93930232f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789579050.767513:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930232c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789579050.767516:0:8:0:(genops.c:885:class_export_put()) final put ffff939302329800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579050.767518:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939302329800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789579050.767521:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579050.767541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef72800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789579050.767544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ee06000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789579050.772481:0:15332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789579050.772500:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579050.772504:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789579050.772511:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789579050.772569:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579050.772580:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579050.772615:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579050.772619:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579050.772624:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e145800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789579050.772629:0:15332:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e145800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789579050.772636:0:15332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789579050.772800:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2095b 00000020:00000080:0.0:1789579050.772808:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e159800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789579050.772813:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789579050.772827:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579050.772833:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789579050.772836:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff93942e150000) has no exports 00000020:00000080:0.0:1789579050.772853:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579050.772856:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789579050.772860:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20962 00000020:00000080:0.0:1789579050.772863:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e15b000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789579050.772871:0:15332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940f42d800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789579050.772874:0:15332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f42d800 2 00000020:01000004:0.0:1789579050.772877:0:15332:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93940f42d800 from lustre-MDT0001 00000020:00000080:1.0:1789579050.772977:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942ee05800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789579050.772985:0:8:0:(genops.c:885:class_export_put()) final put ffff93942ee05000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579050.772988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ee05000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789579050.772995:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789579050.773084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e159800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789579050.773088:0:8:0:(genops.c:885:class_export_put()) final put ffff93942e145000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789579050.773089:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e145000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789579050.773092:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789579050.773246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e15b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789579050.773564:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579050.773571:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789579050.773575:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942e141800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789579050.773578:0:15332:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e141800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789579050.773585:0:15332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789579050.773629:0:15332:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789579050.773634:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789579050.773637:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579050.773649:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579050.773656:0:15332:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93942ef76000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579050.773662:0:15332:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff93941008cd40) has exports, disconnecting them 00000020:00080000:0.0:1789579050.773667:0:15332:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93942ef76000), last request at 1789578807 00000020:00000080:0.0:1789579050.773672:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f209b6 00000020:00080000:0.0:1789579050.773685:0:15332:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942ef76000): rc 0 00000020:00000080:0.0:1789579050.773688:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942ef76000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789579050.775314:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef76000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789579050.793484:0:15332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789579050.793493:0:15332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789579050.793499:0:15332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789579050.793517:0:15332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579050.793543:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942ef77000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789579050.794121:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579050.794132:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789579050.794138:0:15332:0:(genops.c:885:class_export_put()) final put ffff93942ef71000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789579050.794143:0:15332:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef71000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789579050.794154:0:15332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789579050.794221:0:15332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f42d800 1 00000020:00000080:1.0:1789579050.794226:0:15332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f208f2 00000020:00000080:1.0:1789579050.794233:0:15332:0:(genops.c:885:class_export_put()) final put ffff939441aa6800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789579050.794243:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789579050.794255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939441aa6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789579050.794265:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579050.794269:0:15332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789579050.794273:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93943615b380) has no exports 00000020:00000080:1.0:1789579050.834851:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789579050.834865:0:15332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789579050.834870:0:15332:0:(genops.c:885:class_export_put()) final put ffff9394091ea000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789579050.834875:0:15332:0:(genops.c:844:class_export_destroy()) destroying export ffff9394091ea000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789579050.834885:0:15332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789579050.835013:0:15332:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93940f42f800 00000020:01000000:1.0:1789579050.835032:0:15332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789579050.835035:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579050.835040:0:15332:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789579050.835044:0:15332:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9394071a4d40) has no exports 00000100:00100000:1.0:1789579050.835137:0:13782:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff939303b94a00:13782] 4 exiting: rc = 0 00000100:00100000:0.0:1789579050.835346:0:9792:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff939303a1ec00:9792] 3 exiting: rc = 0 00000100:00100000:0.0:1789579050.835469:0:6490:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff939441950600:6490] 0 exiting: rc = 1 00000100:00100000:2.0:1789579050.835491:0:6492:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9394183c8000:6492] 2 exiting: rc = 0 00000100:00100000:2.0:1789579050.835541:0:6491:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9394183c8600:6491] 1 exiting: rc = 0 00000100:00100000:1.0:1789579050.835596:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835604:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835610:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835616:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835621:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835637:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835642:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835648:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835652:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835658:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835672:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835680:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835686:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835692:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835698:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835703:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835709:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835714:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835721:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835726:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835731:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835736:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835741:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835745:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835750:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835756:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835761:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835776:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835781:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835786:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835792:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835796:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835801:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835807:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835812:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835817:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835822:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835828:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835832:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835837:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835849:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835855:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835861:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835866:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835871:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835876:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835882:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835953:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835962:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835967:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835973:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835979:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835984:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835990:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.835995:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836001:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836007:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836012:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836018:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836025:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836030:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836035:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836042:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.836048:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.838634:0:6494:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93941b070000:6494] 1 exiting: rc = 0 00000100:00100000:0.0:1789579050.838704:0:6493:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9394183c9000:6493] 0 exiting: rc = 1 00000100:00100000:1.0:1789579050.838784:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838793:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838799:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838805:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838812:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838818:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838824:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838829:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838835:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838842:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838848:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838864:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838871:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838877:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838882:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838899:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838905:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838910:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838915:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838920:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838926:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838931:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838937:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838941:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838947:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838952:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838957:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838963:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838967:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838973:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838978:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838983:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838989:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838994:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.838999:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839004:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839009:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839014:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839020:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839025:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839031:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839036:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839041:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839046:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839052:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839057:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839070:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839075:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839080:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839086:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839091:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839096:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839101:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839106:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839111:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839117:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839122:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839128:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839133:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839139:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839144:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839150:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839156:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.839162:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.839773:0:9869:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff939303a1ee00:9869] 2 exiting: rc = 0 00000100:00100000:2.0:1789579050.839776:0:6495:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff939407833000:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1789579050.839953:0:6496:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9394382bb000:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1789579050.840041:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840055:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840062:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840069:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840075:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840083:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840089:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840095:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840101:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840107:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840113:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840118:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840124:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840131:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840137:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840142:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840149:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840182:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840188:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840194:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840200:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840208:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840214:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840220:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840225:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840232:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840238:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840244:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840250:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840272:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840280:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840286:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840291:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840295:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840299:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840304:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840309:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840314:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840319:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840324:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840329:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840389:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840397:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840402:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840407:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840414:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840421:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840428:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840434:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840440:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840447:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840452:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840466:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840487:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840495:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840500:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840506:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840517:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840523:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840529:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840535:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840541:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840546:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.840561:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.847831:0:6498:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9394382bac00:6498] 1 exiting: rc = 0 00000100:00100000:0.0:1789579050.848133:0:6497:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff939429022c00:6497] 0 exiting: rc = 1 00000100:00100000:2.0:1789579050.848252:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848260:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848266:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848272:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848290:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848294:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848300:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848305:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848310:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848315:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848320:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848326:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848331:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848335:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848340:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848345:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848374:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848380:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848385:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848391:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848396:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848401:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848406:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848411:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848416:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848420:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848425:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848430:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848435:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848439:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848443:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848448:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848453:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848458:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848463:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848468:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848473:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848479:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848486:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848500:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848506:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848510:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848515:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848520:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848524:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848529:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848534:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848539:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848544:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848549:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848554:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848558:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848563:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848580:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848586:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848591:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848595:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848600:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848605:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848609:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848614:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848618:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848623:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848628:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579050.848919:0:6499:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9394382baa00:6499] 0 exiting: rc = 1 00000100:00100000:3.0:1789579050.849245:0:6500:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9394382ba000:6500] 1 exiting: rc = 0 00000100:00100000:0.0:1789579050.851467:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851475:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851479:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851484:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851489:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851493:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851497:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851502:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851507:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851511:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851516:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851520:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851524:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851528:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851532:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851536:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851540:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851544:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851548:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851552:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851566:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851571:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851575:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851580:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851584:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851588:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851593:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851597:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851601:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851605:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851609:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851613:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851616:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851620:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851624:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851628:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851632:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851638:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851642:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851647:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851651:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851656:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851660:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851664:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851669:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851673:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851677:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851681:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851686:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851690:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851694:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851698:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851702:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851706:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851710:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851719:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851723:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851727:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851731:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851735:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851740:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851744:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851749:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.851754:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.852247:0:6502:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9394382bba00:6502] 1 exiting: rc = 0 00000100:00100000:1.0:1789579050.852326:0:6501:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9394382bae00:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1789579050.855144:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855154:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855160:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855165:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855170:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855176:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855181:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855186:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855191:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855196:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855201:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855206:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855211:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855216:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855221:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855226:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855231:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855236:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855242:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855247:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855252:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855258:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855263:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855268:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855273:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855277:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855293:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855297:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855301:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855306:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855310:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855315:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855319:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855324:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855329:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855335:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855340:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855345:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855467:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855473:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855478:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855483:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855488:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855493:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855497:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855502:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855507:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855511:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855516:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855521:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855526:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855531:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855536:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855541:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855547:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855551:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855556:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855561:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855567:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855572:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855577:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855591:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855596:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.855602:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579050.856217:0:6503:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9394079cfe00:6503] 0 exiting: rc = 1 00000100:00100000:0.0:1789579050.856756:0:6505:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9394079cf600:6505] 2 exiting: rc = 0 00000100:00100000:2.0:1789579050.857055:0:6504:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9394079cf000:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1789579050.857154:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857162:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857170:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857175:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857197:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857204:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857210:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857215:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857221:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857227:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857232:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857238:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857243:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857248:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857254:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857258:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857264:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857270:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857276:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857281:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857287:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857293:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857299:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857304:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857309:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857314:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857320:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857326:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857346:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857386:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857391:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857405:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857409:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857415:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857420:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857425:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857430:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857435:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857441:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857446:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857451:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857457:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857463:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857468:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857473:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857478:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857483:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857489:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857495:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857499:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857504:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857509:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857528:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857535:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857540:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857546:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857551:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857556:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857562:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857567:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857573:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857578:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857584:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579050.857590:0:15332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789579050.861612:0:15332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579050.861626:0:15332:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789579050.861642:0:15332:0:(genops.c:885:class_export_put()) final put ffff9394091e8800/MDS_uuid 00000020:00000080:0.0:1789579050.861647:0:15332:0:(genops.c:844:class_export_destroy()) destroying export ffff9394091e8800/MDS_uuid for MDS 00000020:01000000:0.0:1789579050.861659:0:15332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789579050.861800:0:15332:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789579051.174954:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579052.200326:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579052.387438:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579052.387450:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579052.387453:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579052.387457:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579052.387461:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579052.387470:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1789579052.387478:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789579052.387496:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93942e144800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579052.387542:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439b480 x1876509277189888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579052.387605:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579052.387609:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789579052.387611:0:14907:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579052.387624:0:14907:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1789579052.387628:0:14907:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789579052.387640:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93930232d000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579052.387655:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304398700 x1876509277190144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579052.387745:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277190016:0@lo:400:kworker.0 00000400:00000100:1.0:1789579052.387812:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190016 offset 0 length 224: 4 00000100:00100000:1.0:1789579052.387891:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277190272:0@lo:400:kworker.0 00000400:00000100:1.0:1789579052.387911:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190272 offset 0 length 224: 4 00000100:00100000:2.0:1789579052.388056:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277189888:0@lo:38:kworker.0 00000400:00000100:2.0:1789579052.388083:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277189888 offset 0 length 520: 4 00000100:00100000:2.0:1789579052.388098:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277190144:0@lo:38:kworker.0 00000400:00000100:2.0:1789579052.388114:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190144 offset 0 length 520: 4 00010000:00010000:2.0:1789579053.219551:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579054.244793:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789579054.984169:0:15532:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789579054.999011:0:15532:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789579054.999079:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579054.999097:0:15532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579054.999106:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579054.999113:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579054.999142:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789579054.999149:0:15532:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789579054.999178:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789579054.999193:0:15532:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930439b480 x1876509277189888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579054.999241:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789579054.999250:0:15532:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789579054.999257:0:15532:0:(import.c:65:import_set_state_nolock()) ffff93942e144800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789579054.999263:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789579054.999268:0:15532:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930439b480 x1876509277189888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579072 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579054.999274:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789579054.999278:0:15532:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:0.0:1789579054.999376:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579054.999385:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579054.999394:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2ee00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579054.999398:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579054.999408:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579054.999427:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579054.999435:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789579054.999438:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789579054.999440:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789579054.999458:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:0.0:1789579054.999463:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579054.999470:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2ee00/0xd90373d592f20d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d44 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579054.999482:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579054.999484:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579054.999485:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579054.999658:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277189888:0@lo:38:kworker.0 00000100:00080000:1.0:1789579055.002063:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789579055.002082:0:15532:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930439b100 x1876509277190016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579055.002117:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789579055.002124:0:15532:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789579055.002156:0:15532:0:(import.c:65:import_set_state_nolock()) ffff93942f208800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789579055.002313:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277190400:0@lo:39:umount.0 00000400:00000100:2.0:1789579055.003610:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190400 offset 0 length 224: 4 00000100:00100000:0.0:1789579055.004596:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277190016:0@lo:400:kworker.0 00010000:00010000:2.0:1789579055.271007:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579055.395555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579055.395569:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579055.395573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579055.395577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579055.395723:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579055.397708:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277190528:0@lo:400:kworker.0 00000400:00000100:0.0:1789579055.397804:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190528 offset 0 length 224: 4 00010000:00010000:3.0:1789579056.292183:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789579056.997406:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579056.997416:0:9483:0:(genops.c:885:class_export_put()) final put ffff93943f580800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789579056.997491:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93943f580800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789579056.997553:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93943f582000 for lustre-OST0001 00000001:00100000:2.0:1789579057.001161:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789579057.001170:0:8398:0:(genops.c:885:class_export_put()) final put ffff93942e140000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789579057.001261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e140000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789579057.001346:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942e143000 for lustre-OST0000 00010000:00010000:2.0:1789579057.315745:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579057.443484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579057.443493:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579057.443511:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579057.443515:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789579057.443785:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277190656:0@lo:400:kworker.0 00000400:00000100:2.0:1789579057.443849:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190656 offset 0 length 224: 4 00010000:00010000:3.0:1789579058.346968:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579059.364714:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579060.131914:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579050/real 1789579050] req@ffff93930489c380 x1876509277189376/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579060.131949:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930489c380 x1876509277189376/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789579060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579060.131970:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402adc000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579060.131993:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789579060.131998:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277189376:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789579060.132083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579060.132088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789579060.132091:0:8:0:(import.c:65:import_set_state_nolock()) ffff939402adc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579060.132096:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 405 00000100:00080000:3.0:1789579060.132101:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.137@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579060.132112:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939402adc000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579060.132141:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489ea00 x1876509277190784/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579060.132178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579060.132183:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789579060.132278:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277190784:0@lo:250:kworker.0 00000100:00100000:0.0:1789579060.132320:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277190912:0@lo:400:kworker.0 00000400:00000100:2.0:1789579060.132330:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876509277190784 offset 0 length 520: 4 00000400:00000100:0.0:1789579060.132388:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277190912 offset 0 length 224: 4 00010000:00010000:2.0:1789579060.395056:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579061.413671:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579062.435593:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579063.461369:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579064.484381:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789579065.187620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579065.187631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579065.187635:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789579065.187639:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789579065.187772:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277191040:0@lo:400:kworker.0 00000400:00000100:0.0:1789579065.187826:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277191040 offset 0 length 224: 4 00000100:00100000:2.0:1789579065.251462:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579055/real 1789579055] req@ffff93930439bb80 x1876509277190400/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579065.251516:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930439bb80 x1876509277190400/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789579065.251536:0:3614:0:(import.c:65:import_set_state_nolock()) ffff93942f208800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789579065.251558:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277190400:0@lo:39:umount.0 00000100:00080000:1.0:1789579065.251646:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789579065.251651:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789579065.251656:0:15532:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789579065.252702:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252718:0:15532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252725:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252731:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252839:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579065.252848:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252856:0:15532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252879:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.252885:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579065.255854:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789579065.255873:0:15532:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789579065.255909:0:15532:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789579065.255914:0:15532:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789579065.255922:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789579065.255928:0:15532:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789579065.255932:0:15532:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9393020d8000) has no exports 00000020:00080000:1.0:1789579065.255959:0:15532:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9393020d8000) has no exports 00010000:00010000:2.0:1789579065.257169:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:1.0:1789579065.261852:0:15532:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939302a82720 - data ffff939429d546c0/ffff9393039d6800 00000020:01000000:1.0:1789579065.262029:0:15532:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9393023b7780 - data ffff939429e6e510/ffff9394372b3c00 00010000:00010000:3.0:1789579065.262435:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579065.262447:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579065.262459:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579065.262464:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579065.262475:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579065.262482:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579065.262489:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789579065.262491:0:9493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789579065.262495:0:9493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789579065.262509:0:9493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:3.0:1789579065.262514:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579065.262521:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af600/0xd90373d592f20fb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20fba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579065.262534:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579065.262549:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579065.262552:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579065.264163:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579065.264180:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579065.264184:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579065.264193:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579065.264200:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579065.264205:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789579065.264208:0:10313:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789579065.264210:0:10313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789579065.264223:0:10313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:2.0:1789579065.264227:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579065.264235:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687600/0xd90373d592f20d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d52 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579065.264280:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579065.264282:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579065.264284:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789579065.279121:0:15532:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789579065.292681:0:15532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20a8f 00000020:00000080:0.0:1789579065.292692:0:15532:0:(genops.c:885:class_export_put()) final put ffff93930206b800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789579065.292704:0:15532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943711c800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789579065.292708:0:15532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943711c800 2 00000020:01000004:0.0:1789579065.292711:0:15532:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93943711c800 from lustre-OST0000 00000020:00000080:0.0:1789579065.292732:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579065.292741:0:15532:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789579065.292744:0:15532:0:(genops.c:885:class_export_put()) final put ffff93930206d000/lustre-OST0000_UUID 00000020:00000080:0.0:1789579065.292747:0:15532:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789579065.292754:0:15532:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789579065.292862:0:15532:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789579065.292868:0:15532:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789579065.292871:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579065.292876:0:15532:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579065.292883:0:15532:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93942f20e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579065.292888:0:15532:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff93942e153380) has exports, disconnecting them 00000020:00080000:0.0:1789579065.292892:0:15532:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93942f20e000), last request at 1789578827 00000020:00000080:0.0:1789579065.292896:0:15532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ab9 00000020:00080000:0.0:1789579065.292915:0:15532:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942f20e000): rc 0 00000020:00000080:0.0:1789579065.292920:0:15532:0:(genops.c:885:class_export_put()) final put ffff93942f20e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789579065.292966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93930206b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789579065.292983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942f20e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789579065.294453:0:15532:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789579065.294461:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789579065.294466:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789579065.294473:0:15532:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579065.294592:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942e144800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789579065.295060:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579065.295068:0:15532:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789579065.295073:0:15532:0:(genops.c:885:class_export_put()) final put ffff939441aa1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789579065.295077:0:15532:0:(genops.c:844:class_export_destroy()) destroying export ffff939441aa1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789579065.295088:0:15532:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789579065.295143:0:15532:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789579065.295147:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579065.295152:0:15532:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789579065.295158:0:15532:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93942f20a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579065.295163:0:15532:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9394071a19c0) has exports, disconnecting them 00000020:00080000:2.0:1789579065.295168:0:15532:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93942f20a000), last request at 1789578827 00000020:00000080:2.0:1789579065.295172:0:15532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20ace 00000020:00080000:2.0:1789579065.295187:0:15532:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942f20a000): rc 0 00000020:00000080:2.0:1789579065.295191:0:15532:0:(genops.c:885:class_export_put()) final put ffff93942f20a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789579065.295230:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942f20a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789579065.297430:0:15532:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789579065.297437:0:15532:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579065.297441:0:15532:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789579065.297447:0:15532:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789579065.297471:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93942f208800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789579065.297622:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579065.297629:0:15532:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789579065.297633:0:15532:0:(genops.c:885:class_export_put()) final put ffff93942f208000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789579065.297636:0:15532:0:(genops.c:844:class_export_destroy()) destroying export ffff93942f208000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789579065.297641:0:15532:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789579065.297693:0:15532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943711c800 1 00000020:00000080:3.0:1789579065.297697:0:15532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20a57 00000020:00000080:3.0:1789579065.297703:0:15532:0:(genops.c:885:class_export_put()) final put ffff93942ef72000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789579065.297710:0:15532:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789579065.297716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef72000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789579065.297723:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579065.297728:0:15532:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789579065.297731:0:15532:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9394071a3380) has no exports 00000020:00000080:3.0:1789579065.339137:0:15532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579065.339150:0:15532:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789579065.339156:0:15532:0:(genops.c:885:class_export_put()) final put ffff939437118000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789579065.339161:0:15532:0:(genops.c:844:class_export_destroy()) destroying export ffff939437118000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789579065.339170:0:15532:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789579065.339301:0:15532:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93943711a800 00000020:02000400:3.0:1789579065.339434:0:15532:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789579065.507867:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579066.533761:0:10312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579067.555555:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789579068.259901:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579052/real 1789579052] req@ffff93930439a300 x1876509277190272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579068 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579068.282434:0:3615:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93930439a300 x1876509277190272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789579068 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789579068.282450:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9394370cc800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789579068.282455:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789579068.293883:0:3615:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789579068.294148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579068.294154:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579068.294157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579068.294160:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579068.294163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789579068.294166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579068.294169:0:36:0:(import.c:65:import_set_state_nolock()) ffff9394370cc800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579068.294176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 202 00000100:00080000:3.0:1789579068.294189:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9394370cc800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579068.294222:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489c380 x1876509277191168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579068.294619:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277190272:0@lo:400:kworker.0 00000100:00100000:0.0:1789579068.294708:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277191168:0@lo:38:kworker.0 00000400:00000100:0.0:1789579068.294755:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876509277191168 offset 0 length 520: 4 00000020:01000004:3.0:1789579068.425209:0:15734:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789579068.436039:0:15734:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789579068.436126:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579068.436140:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579068.436148:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579068.436155:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579068.436216:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789579068.436245:0:15734:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789579068.436268:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579068.436279:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939304398700 x1876509277190144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.436301:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789579068.436307:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579068.436313:0:15734:0:(import.c:65:import_set_state_nolock()) ffff93930232d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789579068.436317:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789579068.436322:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939304398700 x1876509277190144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579072 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.436329:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789579068.436332:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1789579068.436471:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579068.436479:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579068.436487:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401687000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579068.436491:0:9493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579068.436500:0:9493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579068.436507:0:9493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579068.436512:0:9493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789579068.436515:0:9493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789579068.436524:0:9493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789579068.436546:0:9493:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:0.0:1789579068.436551:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579068.436557:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401687000/0xd90373d592f20d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d28 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579068.436569:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579068.436571:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579068.436573:0:9493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579068.437315:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277190144:0@lo:38:kworker.0 00000100:00080000:3.0:1789579068.439300:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789579068.439314:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939304398e00 x1876509277190528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579071 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.439342:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff939304399c00 x1876509277190656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579068.439412:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277190528:0@lo:400:kworker.0 00000100:00100000:3.0:1789579068.441508:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930489ce00 x1876509277190912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.441526:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930439b100 x1876509277191040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.441535:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930489c380 x1876509277191168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789579078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579068.441550:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789579068.441610:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277190656:0@lo:400:kworker.0 00000100:00080000:3.0:1789579068.442402:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789579068.442620:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277190912:0@lo:400:kworker.0 00000100:00100000:1.0:1789579068.444311:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277191040:0@lo:400:kworker.0 00000100:00080000:1.0:1789579068.444423:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9394370cc800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579068.444430:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789579068.444435:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277191168:0@lo:38:kworker.0 00000100:00080000:3.0:1789579068.444438:0:15734:0:(import.c:65:import_set_state_nolock()) ffff9394370cc800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789579068.444527:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789579068.444532:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789579068.444555:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789579068.445785:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445803:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445810:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445901:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445924:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579068.445932:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445938:0:15734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445943:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.445949:0:15734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.445956:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579068.445966:0:15734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789579068.445973:0:15734:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1789579068.445975:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.445985:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579068.445989:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789579068.445997:0:15734:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1789579068.445998:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789579068.446004:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:00010000:1.0:1789579068.446009:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789579068.446011:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1789579068.446016:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789579068.446021:0:10313:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789579068.446025:0:10313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00000080:2.0:1789579068.446026:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789579068.446032:0:15734:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff939303574d40) has no exports 00010000:00010000:1.0:1789579068.446039:0:10313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:1.0:1789579068.446044:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.446051:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2e800/0xd90373d592f20d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d36 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789579068.446055:0:15734:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff939303574d40) has no exports 00010000:00010000:1.0:1789579068.446067:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579068.446071:0:10313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.446078:0:10313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579068.446080:0:10313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.446098:0:10313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579068.446105:0:10313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579068.446111:0:10313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789579068.446113:0:10313:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789579068.446115:0:10313:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789579068.446121:0:10313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:1.0:1789579068.446124:0:10313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.446130:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939401518000/0xd90373d592f20fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20fac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579068.446144:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579068.446146:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579068.446148:0:10313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579068.446264:0:6478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789579068.448526:0:15734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff939302a82a80 - data ffff9393024cca20/ffff93942f026800 00000020:01000000:2.0:1789579068.448684:0:15734:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9394373fef00 - data ffff939302589bd0/ffff93943f5e2000 00100000:10000000:2.0:1789579068.468136:0:15734:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789579068.479990:0:15734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20bb5 00000020:00000080:2.0:1789579068.480001:0:15734:0:(genops.c:885:class_export_put()) final put ffff939441aa5800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789579068.480056:0:15734:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939302b3c800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789579068.480060:0:15734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939302b3c800 2 00000020:01000004:2.0:1789579068.480063:0:15734:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939302b3c800 from lustre-OST0001 00000020:00000080:0.0:1789579068.480090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939441aa5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789579068.480092:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579068.480103:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789579068.480107:0:15734:0:(genops.c:885:class_export_put()) final put ffff93930232e800/lustre-OST0001_UUID 00000020:00000080:2.0:1789579068.480110:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff93930232e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789579068.480117:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789579068.480319:0:15734:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 42b2619d-9ae6-4775-a880-4d874c1635bc->MGS 00010000:00010000:2.0:1789579068.480416:0:15734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f2090e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579068.480429:0:15734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f2090e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579068.480435:0:15734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789579068.480438:0:15734:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789579068.480442:0:15734:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789579068.480606:0:15734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:2.0:1789579068.480611:0:15734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f2090e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20915 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579068.480632:0:15734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579068.480652:0:15734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579068.480657:0:15734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789579068.480659:0:15734:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789579068.480661:0:15734:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789579068.480671:0:15734:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939402adc000 00010000:00010000:2.0:1789579068.480674:0:15734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939302b2f800/0xd90373d592f20d91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd90373d592f20d98 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789579068.480690:0:15734:0:(import.c:65:import_set_state_nolock()) ffff939402adc000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789579068.480694:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789579068.480696:0:15734:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789579068.480697:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789579068.480747:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789579068.480910:0:15734:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93930489ea00 x1876509277190784/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789579075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789579068.480974:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789579068.480978:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1789579068.484296:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42b2619d-9ae6-4775-a880-4d874c1635bc:3614:1876509277190784:0@lo:250:kworker.0 10000000:01000000:2.0:1789579068.484346:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789579068.484391:0:15734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f2080b 00000020:00000080:2.0:1789579068.484400:0:15734:0:(genops.c:885:class_export_put()) final put ffff9394091ed800/42b2619d-9ae6-4775-a880-4d874c1635bc 00000020:01000000:2.0:1789579068.484413:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.137@tcp (flags='') 00000020:00000080:2.0:1789579068.484420:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579068.484427:0:15734:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789579068.484431:0:15734:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93941008b380) has no exports 10000000:01000000:2.0:1789579068.484451:0:6487:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789579068.484513:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.137@tcp: client import never connected 00000100:00080000:2.0:1789579068.484517:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789579068.484520:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789579068.484522:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789579068.484533:0:15734:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789579068.484575:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579068.484581:0:15734:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.137@tcp (uuid 42b2619d-9ae6-4775-a880-4d874c1635bc) 00000020:01000000:2.0:1789579068.484587:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789579068.484590:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579068.484593:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789579068.484597:0:15734:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93942ef70800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789579068.484602:0:15734:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff939303570000) has exports, disconnecting them 00000020:00080000:2.0:1789579068.484606:0:15734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93942ef70800), last request at 1789578847 00000020:00000080:2.0:1789579068.484610:0:15734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20bdf 00000020:00080000:2.0:1789579068.484620:0:15734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93942ef70800): rc 0 00000020:00000080:2.0:1789579068.484623:0:15734:0:(genops.c:885:class_export_put()) final put ffff93942ef70800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789579068.485726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9394091ed800/42b2619d-9ae6-4775-a880-4d874c1635bc for MGC192.168.203.137@tcp 00000020:00000080:0.0:1789579068.485742:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff939402adc000 for MGC192.168.203.137@tcp 00000020:00000080:0.0:1789579068.485748:0:8:0:(genops.c:885:class_export_put()) final put ffff93940866d800/42b2619d-9ae6-4775-a880-4d874c1635bc 00000020:00000080:0.0:1789579068.485750:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93940866d800/42b2619d-9ae6-4775-a880-4d874c1635bc for MGC192.168.203.137@tcp 00000020:01000000:0.0:1789579068.485755:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.137@tcp (42b2619d-9ae6-4775-a880-4d874c1635bc) 00000020:00000080:0.0:1789579068.486008:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef70800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789579068.486387:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789579068.486392:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789579068.486396:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789579068.486402:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789579068.486543:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789579068.486550:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789579068.486554:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789579068.486559:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789579068.486570:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789579068.486576:0:15734:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff939441aa3000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789579068.486581:0:15734:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff93942e1519c0) has exports, disconnecting them 00000020:00080000:0.0:1789579068.486585:0:15734:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff939441aa3000), last request at 1789578847 00000020:00000080:0.0:1789579068.486589:0:15734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20bf4 00000020:00080000:0.0:1789579068.486602:0:15734:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff939441aa3000): rc 0 00000020:00000080:0.0:1789579068.486607:0:15734:0:(genops.c:885:class_export_put()) final put ffff939441aa3000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789579068.487318:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93930232d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789579068.487327:0:8:0:(genops.c:885:class_export_put()) final put ffff939302069000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789579068.487330:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939302069000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789579068.487340:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789579068.487405:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff939441aa3000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789579068.488444:0:15734:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789579068.488451:0:15734:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789579068.488463:0:15734:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789579068.488469:0:15734:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789579068.488495:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9394370cc800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789579068.491815:0:10312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789579068.492387:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789579068.494404:0:9493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789579068.494687:0:10313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:1.0:1789579068.494885:0:6478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1789579068.495025:0:6474:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93940391c400:6474] 1 exiting: rc = 0 00000100:00100000:1.0:1789579068.495127:0:6473:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93941016ec00:6473] 0 exiting: rc = 1 00000100:00100000:3.0:1789579068.495460:0:8420:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_003: service thread [ffff939302057200:8420] 3 exiting: rc = 0 00000100:00100000:1.0:1789579068.496423:0:8419:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93942f249400:8419] 2 exiting: rc = 0 00000100:00100000:3.0:1789579068.496539:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579068.496989:0:6476:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93941016f800:6476] 1 exiting: rc = 0 00000100:00100000:1.0:1789579068.497059:0:9492:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93930350b800:9492] 3 exiting: rc = 0 00000100:00100000:3.0:1789579068.497150:0:6475:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff939441a99000:6475] 0 exiting: rc = 1 00000100:00100000:3.0:1789579068.497209:0:13705:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff939303a7ee00:13705] 4 exiting: rc = 0 00000100:00100000:3.0:1789579068.497274:0:6477:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93941016f600:6477] 2 exiting: rc = 0 00000100:00100000:3.0:1789579068.497322:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497330:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497336:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497342:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497409:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497417:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497423:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497429:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497435:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497440:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497447:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497453:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497459:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497466:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497472:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497478:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497483:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497489:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497495:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497501:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497508:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497513:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497519:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497524:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497530:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497534:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497540:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497546:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497551:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497567:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497573:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497578:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497583:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497589:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497594:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497600:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497605:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497610:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497616:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497620:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497625:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497631:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497636:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497641:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497647:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497651:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497657:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497662:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497667:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497672:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497677:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497681:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497687:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497691:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497697:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497702:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497706:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497711:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497783:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497792:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497797:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497803:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497808:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789579068.497814:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789579068.498793:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789579068.498803:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789579068.498808:0:15734:0:(genops.c:885:class_export_put()) final put ffff93942e146000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789579068.498812:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff93942e146000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789579068.498817:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789579068.498860:0:15734:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939302b3c800 1 00000020:00000080:3.0:1789579068.498866:0:15734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd90373d592f20b84 00000020:00000080:3.0:1789579068.498871:0:15734:0:(genops.c:885:class_export_put()) final put ffff9394371f0800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789579068.498915:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789579068.498920:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789579068.498924:0:15734:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789579068.498929:0:15734:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9393020dcd40) has no exports 00000020:00000080:1.0:1789579068.501483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9394371f0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789579068.546029:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579068.546044:0:15734:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789579068.546050:0:15734:0:(genops.c:885:class_export_put()) final put ffff939302b39000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789579068.546054:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff939302b39000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789579068.546060:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789579068.546447:0:15734:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939302b3b000 00000020:01000000:2.0:1789579068.546468:0:15734:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789579068.546472:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789579068.546476:0:15734:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789579068.546480:0:15734:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff939410088000) has no exports 00000020:00000080:2.0:1789579068.546513:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789579068.546519:0:15734:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789579068.546522:0:15734:0:(genops.c:885:class_export_put()) final put ffff93942ef73800/OSS_uuid 00000020:00000080:2.0:1789579068.546524:0:15734:0:(genops.c:844:class_export_destroy()) destroying export ffff93942ef73800/OSS_uuid for OSS 00000020:01000000:2.0:1789579068.546659:0:15734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789579068.546779:0:6486:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789579068.547174:0:8403:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff939441a99600:8403] 0 exiting: rc = 1 00000100:00100000:3.0:1789579068.547237:0:8404:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff93942ef5aa00:8404] 1 exiting: rc = 0 00000100:00100000:0.0:1789579068.547316:0:8405:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9394370e3400:8405] 2 exiting: rc = 0 00000100:00100000:0.0:1789579068.547711:0:10029:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff93942f10d000:10029] 3 exiting: rc = 0 00000100:00100000:2.0:1789579068.547927:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.547964:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.547971:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.547978:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.547985:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548004:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548008:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548013:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548018:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548024:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548029:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548034:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548040:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548046:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548052:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548058:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548064:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548068:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548074:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548078:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548083:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548088:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548093:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548110:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548116:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548121:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548127:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548132:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548136:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548141:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548146:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548151:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548156:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548160:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548165:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548170:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548175:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548180:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548185:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548190:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548203:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548208:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548213:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548218:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548223:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548238:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548250:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548257:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548262:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548268:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548273:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548279:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548285:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548290:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548296:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548301:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548306:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548311:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548317:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548322:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548327:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548333:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548338:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.548344:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579068.550504:0:8407:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9394362d6800:8407] 1 exiting: rc = 0 00000100:00100000:3.0:1789579068.550710:0:8406:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93941a9f4600:8406] 0 exiting: rc = 1 00000100:00100000:0.0:1789579068.551004:0:8664:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9394087a7200:8664] 2 exiting: rc = 0 00000100:00100000:2.0:1789579068.551100:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551109:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551115:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551121:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551126:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551131:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551136:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551141:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551147:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551152:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551157:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551174:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551179:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551185:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551190:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551195:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551200:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551205:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551210:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551254:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551261:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551267:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551272:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551277:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551282:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551286:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551291:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551296:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551301:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551306:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551311:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551316:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551321:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551326:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551331:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551337:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551342:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551402:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551409:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551414:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551419:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551424:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551428:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551434:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551439:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551445:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551458:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551462:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551467:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551472:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551476:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551481:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551486:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551491:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551496:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551500:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551505:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551509:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551514:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551519:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551524:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551529:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551534:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.551540:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789579068.552708:0:8410:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9394362d6400:8410] 2 exiting: rc = 0 00000100:00100000:3.0:1789579068.553143:0:8409:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9394362d7600:8409] 1 exiting: rc = 0 00000100:00100000:0.0:1789579068.553465:0:8408:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9394362d6600:8408] 0 exiting: rc = 1 00000100:00100000:2.0:1789579068.553577:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553597:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553603:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553609:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553615:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553622:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553628:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553635:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553640:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553646:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553652:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553658:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553664:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553670:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553676:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553682:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553688:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553719:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553726:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553732:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553737:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553743:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553748:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553754:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553769:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553775:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553780:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553786:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553794:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553799:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553804:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553810:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553816:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553822:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553827:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553832:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553848:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553855:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553860:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553866:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553871:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553891:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553897:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553903:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553908:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553915:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553921:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553926:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553931:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553937:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553942:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553948:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553960:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553965:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553970:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553976:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553982:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553988:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553994:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.553999:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.554005:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.554011:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.554017:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.554023:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789579068.559286:0:8411:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93942f245a00:8411] 0 exiting: rc = 1 00000100:00100000:0.0:1789579068.559418:0:8412:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93942f245e00:8412] 1 exiting: rc = 0 00000100:00100000:2.0:1789579068.559526:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559544:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559550:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559555:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559560:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559565:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559570:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559575:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559581:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559703:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559711:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559717:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559722:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559727:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559732:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559737:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559742:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559747:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559752:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559814:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559821:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559826:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559831:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559901:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559906:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559911:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559916:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559924:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559929:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559934:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559939:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559944:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559950:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559955:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559960:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559965:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559970:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559975:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559981:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559986:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559991:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.559996:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560001:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560007:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560011:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560016:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560022:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560027:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560032:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560038:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560042:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560047:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560051:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560056:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560061:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560065:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560070:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560075:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560087:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560096:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560102:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560108:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560113:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.560124:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565049:0:8414:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93943630c800:8414] 1 exiting: rc = 0 00000100:00100000:3.0:1789579068.565331:0:8413:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93942f248400:8413] 0 exiting: rc = 1 00000100:00100000:2.0:1789579068.565522:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565653:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565668:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565676:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565682:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565689:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565696:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565703:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565709:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565714:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565720:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565736:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565742:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565748:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565753:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565820:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565827:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565832:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565902:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565909:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565914:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565920:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565926:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565945:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565952:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565957:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565963:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565968:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565986:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565992:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.565998:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566003:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566009:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566016:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566022:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566041:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566049:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566055:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566062:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566068:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566074:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566080:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566086:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566092:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566098:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566104:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566110:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566130:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566138:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566144:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566151:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566157:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566163:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566169:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566175:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566181:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566187:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566193:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566199:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566216:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566223:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566238:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566245:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789579068.566265:0:15734:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789579068.577944:0:15734:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789579085.248507:0:16498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789579094.823178:0:17097:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789579094.823184:0:17097:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789579094.823186:0:17097:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789579094.823293:0:17097:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff939304130800 00000020:01000004:3.0:1789579094.823307:0:17097:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789579094.823314:0:17097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789579094.823328:0:17097:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93943f5419c0) 00000020:00000080:3.0:1789579094.823341:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789579094.889905:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789579094.890105:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.895242:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.898624:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.899237:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.899739:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.899974:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.900512:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.900787:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.900964:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.901213:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.901745:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.901993:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.902536:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789579094.903096:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789579094.908923:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.909262:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.909833:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.910104:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.910522:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.910805:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.911113:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.911581:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.911898:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.912105:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.917084:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.917521:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.917858:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.918116:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.918500:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.918808:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789579094.919053:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.919491:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.919840:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789579094.920089:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.922764:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.923499:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.924753:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.925230:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.925927:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.927501:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.928602:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.929985:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.930586:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.930902:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789579094.931108:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.931744:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789579094.932886:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789579094.933553:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789579094.934049:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789579094.934895:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789579094.935112:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789579094.935631:0:17097:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1789579094.936238:0:17097:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789579094.937332:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789579094.937340:0:17097:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789579094.937381:0:17097:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21dba 00000020:01000004:2.0:1789579094.937411:0:17097:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789579094.937416:0:17097:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789579094.937420:0:17097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939304130800 from MGS 00000020:01000004:2.0:1789579094.937424:0:17097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789579094.937434:0:17097:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93942e153380) 00000020:00000080:2.0:1789579094.937445:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789579094.937502:0:17097:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939304130800 from MGS, refs=2 00080000:01000000:2.0:1789579094.937507:0:17097:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789579094.937512:0:17097:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21dc8 00000100:00100000:2.0:1789579094.937614:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789579094.937743:0:17097:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789579094.937748:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789579094.941800:0:17097:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789579094.941813:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789579094.947629:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789579094.947892:0:17097:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789579094.947899:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789579094.949178:0:17097:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789579094.949188:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789579094.952110:0:17097:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789579094.952122:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789579094.953112:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579094.953116:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579094.953118:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579094.953331:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579094.953334:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579094.953335:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579094.954119:0:17097:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789579094.958212:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789579094.961444:0:17097:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789579094.965095:0:17109:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789579094.967693:0:17097:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789579094.967746:0:17097:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789579094.968750:0:17097:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789579094.969067:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789579094.969206:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789579094.969211:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789579094.970743:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789579094.970752:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789579094.972713:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789579094.972722:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789579094.973894:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789579094.973914:0:17097:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.137@tcp' 00000020:01000004:3.0:1789579094.973915:0:17097:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789579094.973945:0:17097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.137@tcp (typ=mgc) 00000020:00000080:3.0:1789579094.973958:0:17097:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.137@tcp (ffff93943f544d40) 00000020:00000080:3.0:1789579094.973973:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789579094.974058:0:17097:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939436336800@MGC192.168.203.137@tcp: add connection 192.168.203.137@tcp at head 00010000:00010000:3.0:1789579094.974194:0:17097:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.137@tcp-0 is initialized 00000040:01000000:3.0:1789579094.974199:0:17097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789579094.974416:0:17114:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789579094.976089:0:17115:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789579094.976243:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.137@tcp (uuid 044b3bf9-43fa-4501-b924-7b81ca047525) 00000020:00000080:3.0:1789579094.976263:0:17097:0:(genops.c:1384:class_connect()) connect: client 044b3bf9-43fa-4501-b924-7b81ca047525, cookie 0xd90373d592f21dd6 00000100:00080000:3.0:1789579094.976326:0:17097:0:(import.c:545:import_select_connection()) MGC192.168.203.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579094.976343:0:17097:0:(import.c:666:import_select_connection()) MGC192.168.203.137@tcp: import ffff939436336800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579094.977023:0:17097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489d880 x1876509277191296/t0(0) o250->MGC192.168.203.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579094.977101:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277191296:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1789579094.977209:0:17097:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 044b3bf9-43fa-4501-b924-7b81ca047525->MGS 00000020:01000004:3.0:1789579094.977235:0:17097:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789579094.977241:0:17097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789579094.977254:0:17097:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93943f540000) 00000020:00000080:3.0:1789579094.977265:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789579094.977345:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579094.978262:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191296 00000100:00100000:2.0:1789579094.978278:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191296 00000100:00100000:2.0:1789579094.978310:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579094.978317:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3614:x1876509277191296:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789579094.978340:0:17111:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 044b3bf9-43fa-4501-b924-7b81ca047525@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1789579094.978379:0:17111:0:(genops.c:1384:class_connect()) connect: client 044b3bf9-43fa-4501-b924-7b81ca047525, cookie 0xd90373d592f21de4 00000100:00080000:2.0:1789579094.979650:0:17111:0:(import.c:65:import_set_state_nolock()) ffff93943f7ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579094.979731:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+5:3614:x1876509277191296:12345-0@lo:250:mount.lustre.0 Request processed in 1412us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579094.979740:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579094.982732:0:3614:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789579094.982750:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.137@tcp: connect to target with instance 0 00000100:00080000:1.0:1789579094.982759:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789579094.982765:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789579094.982770:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436336800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789579094.982785:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789579094.982809:0:3614:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789579094.982819:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:044b3bf9-43fa-4501-b924-7b81ca047525:3614:1876509277191296:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789579094.991435:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579094.992185:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789579094.992192:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789579094.996642:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789579094.996658:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789579095.002340:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789579095.002375:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789579095.003190:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579095.003445:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789579095.003451:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789579095.004421:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789579095.004431:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789579095.066900:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579095.067096:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789579095.067102:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789579095.069979:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789579095.069990:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789579095.070777:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579095.070954:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789579095.070960:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789579095.071632:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789579095.071722:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789579095.072224:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579095.072525:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789579095.072530:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789579095.072934:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789579095.072941:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789579095.073867:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789579095.074042:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789579095.074049:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789579095.074810:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789579095.074818:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789579095.109840:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579095.110093:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789579095.110100:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789579095.112768:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789579095.112852:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789579095.113857:0:17097:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789579095.113867:0:17097:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789579095.116449:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789579095.116482:0:17097:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789579095.116489:0:17097:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789579095.116721:0:17097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789579095.116759:0:17097:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789579095.116763:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789579095.116765:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579095.116767:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579095.116768:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579095.116769:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579095.116771:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579095.116772:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579095.116842:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579095.116844:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579095.116845:0:17097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789579095.116848:0:17097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789579095.116851:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789579095.116852:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579095.116853:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579095.116854:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579095.116855:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579095.116856:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579095.116857:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579095.116858:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579095.116859:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579095.116861:0:17097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789579095.116887:0:17097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789579095.116906:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789579095.116972:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.117074:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.117557:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191424 00000100:00100000:0.0:1789579095.117621:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191424 00000100:00100000:0.0:1789579095.117699:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579095.117709:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+5:17097:x1876509277191424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789579095.117770:0:17113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789579095.117846:0:17113:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789579095.117849:0:17113:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789579095.118222:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789579095.118703:0:17113:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789579095.120240:0:17135:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789579095.120246:0:17135:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789579095.120248:0:17135:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789579095.120251:0:17135:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789579095.120554:0:17135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789579095.121241:0:17113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789579095.121252:0:17113:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789579095.132763:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+5:17097:x1876509277191424:12345-0@lo:253:mount.lustre.0 Request processed in 15047us (15782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.132782:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579095.132817:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579095.132834:0:17097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789579095.132837:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579095.132839:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789579095.132841:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579095.132842:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579095.132844:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579095.132845:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579095.132846:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579095.132848:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789579095.132850:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579095.132851:0:17097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789579095.132871:0:17097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939304130800 from lustre-MDT0000 10000000:01000000:0.0:1789579095.132900:0:17097:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789579095.132903:0:17097:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789579095.132907:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93943f544d40 10000000:01000000:0.0:1789579095.132912:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579095.132920:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93943f544d40 from 1 10000000:01000000:0.0:1789579095.132923:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789579095.132959:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.132970:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.132979:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.132998:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579095.133048:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.133082:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579095.133458:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191552 00000100:00100000:2.0:1789579095.133465:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191552 00000100:00100000:2.0:1789579095.133509:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789579095.133518:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+5:17097:x1876509277191552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579095.133537:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579095.133551:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af000/0xd90373d592f21df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21deb expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.133572:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af000/0xd90373d592f21df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21deb expref: 6 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.133583:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af000/0xd90373d592f21df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21deb expref: 6 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.133591:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af000, rc 0) 00000100:00100000:2.0:1789579095.133633:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+6:17097:x1876509277191552:12345-0@lo:101:mount.lustre.0 Request processed in 116us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579095.133639:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789579095.133650:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579095.133663:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.133673:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.133723:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579095.133747:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.133772:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579095.133928:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191680 00000100:00100000:1.0:1789579095.133933:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191680 00000100:00100000:1.0:1789579095.133963:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579095.133971:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+6:17097:x1876509277191680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.134066:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+6:17097:x1876509277191680:12345-0@lo:501:mount.lustre.0 Request processed in 95us (317us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789579095.134072:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789579095.134072:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191680:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789579095.134096:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789579095.134116:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.134125:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579095.134133:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939304130800 10000000:01000000:0.0:1789579095.134137:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789579095.134141:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939304130800 10000000:01000000:0.0:1789579095.134143:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789579095.134145:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff939304130800 from 1 10000000:01000000:0.0:1789579095.134148:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789579095.134162:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.134174:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.134182:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.134194:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579095.134219:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.134240:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579095.134258:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191808 00000100:00100000:3.0:1789579095.134263:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191808 00000100:00100000:3.0:1789579095.134324:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579095.134331:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+6:17097:x1876509277191808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579095.134338:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579095.134370:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7e00/0xd90373d592f21e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21df9 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579095.134386:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7e00/0xd90373d592f21e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21df9 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579095.134395:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7e00/0xd90373d592f21e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21df9 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579095.134401:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7e00, rc 0) 00000100:00100000:3.0:1789579095.134437:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+7:17097:x1876509277191808:12345-0@lo:101:mount.lustre.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579095.134442:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789579095.134955:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579095.134968:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.134977:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579095.134987:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789579095.134995:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.135002:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303436000/0xd90373d592f21df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e00 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579095.135008:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789579095.135012:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579095.135016:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939304130800 10000000:01000000:0.0:1789579095.135018:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789579095.135029:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789579095.135043:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789579095.135059:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.135067:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.135074:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.135086:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579095.135111:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.145300:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277191936 00000100:00100000:0.0:1789579095.145363:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579095.145591:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277191936 00000100:00100000:1.0:1789579095.145673:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789579095.145683:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+7:17097:x1876509277191936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579095.145699:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579095.145729:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304367600/0xd90373d592f21e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21e07 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.145757:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304367600/0xd90373d592f21e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21e07 expref: 8 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.145768:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304367600/0xd90373d592f21e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21e07 expref: 8 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.145777:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367600, rc 0) 00000100:00100000:1.0:1789579095.145850:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+8:17097:x1876509277191936:12345-0@lo:101:mount.lustre.0 Request processed in 168us (10737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.145856:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579095.146087:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277191936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579095.146104:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.146114:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.146191:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579095.146226:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.146262:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579095.146733:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192064 00000100:00100000:1.0:1789579095.146738:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192064 00000100:00100000:1.0:1789579095.146776:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789579095.146785:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+8:17097:x1876509277192064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.146944:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+9:17097:x1876509277192064:12345-0@lo:501:mount.lustre.0 Request processed in 159us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.146951:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579095.147024:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579095.147068:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579095.147110:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.147145:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579095.147193:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192192 00000100:00100000:1.0:1789579095.147198:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192192 00000100:00100000:1.0:1789579095.147217:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579095.147223:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+9:17097:x1876509277192192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579095.149694:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+9:17097:x1876509277192192:12345-0@lo:503:mount.lustre.0 Request processed in 2462us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.149706:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789579095.149828:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579095.150311:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17136:1876509277192320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789579095.151788:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579095.151826:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579095.151828:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192320 00000100:00100000:1.0:1789579095.151836:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192320 00000100:00100000:1.0:1789579095.151882:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579095.151891:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+9:17136:x1876509277192320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789579095.153162:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+9:17136:x1876509277192320:12345-0@lo:502:llog_process_th.0 Request processed in 1266us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.153173:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579095.153397:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17136:1876509277192320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789579095.153495:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579095.153507:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579095.153510:0:17136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789579095.153515:0:17136:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789579095.153518:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789579095.153533:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93942e154d40) 00000020:00000080:2.0:1789579095.153549:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789579095.153555:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789579095.154002:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789579095.154013:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e1c 00000020:00000080:2.0:1789579095.154225:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789579095.154230:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579095.154241:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579095.154243:0:17136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789579095.154246:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579095.154249:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579095.154250:0:17136:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789579095.154254:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789579095.154263:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93942e1519c0) 00000020:00000080:2.0:1789579095.155021:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789579095.155045:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789579095.155048:0:17136:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789579095.155051:0:17136:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789579095.155058:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789579095.155118:0:17136:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939304130800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789579095.155133:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93942e150000) 00000020:00000080:2.0:1789579095.155142:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789579095.155207:0:17136:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789579095.155213:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f21e31 00000020:00000080:2.0:1789579095.156126:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789579095.156136:0:17136:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789579095.156145:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd90373d592f21e38 00080000:01000000:2.0:1789579095.156153:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789579095.156157:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e3f 00010000:00010000:0.0:1789579095.247619:0:17136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789579095.248232:0:17136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1789579095.248660:0:17136:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789579095.249732:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff939303573380) 00000020:00000080:0.0:1789579095.249752:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789579095.249836:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789579095.249844:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e4d 00000020:00000080:1.0:1789579095.252657:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789579095.260956:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd90373d592f21e54 00000020:00000080:1.0:1789579095.261544:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789579095.261556:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579095.261562:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.261564:0:17136:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789579095.261567:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789579095.261570:0:17136:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789579095.261571:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789579095.261573:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789579095.261575:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789579095.261586:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.261587:0:17136:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789579095.261590:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579095.261595:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.261596:0:17136:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789579095.261600:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789579095.261635:0:17136:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789579095.261650:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579095.261653:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.261655:0:17136:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789579095.261657:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579095.261660:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.261662:0:17136:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789579095.261665:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789579095.261670:0:17136:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:1.0:1789579095.261700:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789579095.261715:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93942edf8000) 00000020:00000080:1.0:1789579095.261728:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789579095.261733:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789579095.261786:0:17136:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789579095.261792:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789579095.261798:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e62 00010000:00080000:1.0:1789579095.261829:0:17136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939407188000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579095.268264:0:17136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789579095.270751:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789579095.270765:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789579095.270798:0:17136:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789579095.270816:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f21e69 00000100:00080000:1.0:1789579095.270826:0:17136:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789579095.270837:0:17136:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579095.270882:0:17136:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304398e00 x1876509277192448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579095.270954:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579095.271069:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789579095.271145:0:17136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789579095.271217:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579095.271221:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.271224:0:17136:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789579095.271227:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789579095.271230:0:17136:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789579095.271232:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789579095.271234:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789579095.271236:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789579095.271238:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.271240:0:17136:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789579095.271242:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789579095.271247:0:17136:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789579095.271251:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579095.271253:0:17136:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789579095.271256:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789579095.271260:0:17136:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:1.0:1789579095.271282:0:17136:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789579095.271285:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789579095.271298:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93942edfb380) 00000020:00000080:1.0:1789579095.271309:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789579095.271315:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789579095.271431:0:17136:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789579095.271438:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789579095.271443:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e77 00010000:00080000:1.0:1789579095.271472:0:17136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939407190000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579095.271681:0:17136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789579095.271971:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192448 00000100:00100000:3.0:1789579095.271979:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192448 00000100:00100000:3.0:1789579095.272014:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579095.272039:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277192448:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789579095.272055:0:17123:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1789579095.278700:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789579095.280589:0:17136:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789579095.283588:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579095.283821:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789579095.292728:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789579095.296847:0:17142:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789579095.296867:0:17142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789579095.299453:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277192448:12345-0@lo:38:llog_process_th.0 Request processed in 27418us (28378us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789579095.299470:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789579095.299525:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579095.299530:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579095.299534:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192448:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1789579095.303708:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789579095.303723:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789579095.303763:0:17136:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789579095.303784:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f21e7e 00000100:00080000:0.0:1789579095.303794:0:17136:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579095.303805:0:17136:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939407190000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579095.303838:0:17136:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a30380 x1876509277192576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579095.303944:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192576:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789579095.304006:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277192576 offset 0 length 520: 4 00000100:00080000:0.0:1789579095.304068:0:17136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789579095.304132:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579095.304136:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.304138:0:17136:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789579095.304141:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789579095.304144:0:17136:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789579095.304150:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789579095.304153:0:17136:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789579095.304154:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789579095.304157:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.304158:0:17136:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789579095.304161:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789579095.304165:0:17136:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789579095.304168:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.304169:0:17136:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789579095.304172:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789579095.304175:0:17136:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:0.0:1789579095.304194:0:17136:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789579095.304196:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789579095.304207:0:17136:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9393035719c0) 00000020:00000080:0.0:1789579095.304218:0:17136:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789579095.304222:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789579095.304288:0:17136:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789579095.304294:0:17136:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789579095.304301:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd90373d592f21e8c 00010000:00080000:0.0:1789579095.304337:0:17136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939402ad9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789579095.304793:0:17136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789579095.304933:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789579095.304951:0:17136:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789579095.306763:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579095.307054:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789579095.307172:0:17136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789579095.311584:0:17144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789579095.311592:0:17144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789579095.312498:0:17136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789579095.312509:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789579095.312542:0:17136:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789579095.312613:0:17136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f21e93 00000100:00080000:0.0:1789579095.312623:0:17136:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579095.312634:0:17136:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939402ad9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579095.312673:0:17136:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a31500 x1876509277192704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579095.312731:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192704:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789579095.312789:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277192704 offset 0 length 520: 4 00000100:00080000:0.0:1789579095.312930:0:17136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789579095.312982:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579095.312986:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.312988:0:17136:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789579095.312991:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579095.312995:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.312996:0:17136:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789579095.312998:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789579095.313000:0:17136:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789579095.313002:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579095.313004:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.313005:0:17136:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789579095.313007:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579095.313009:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.313010:0:17136:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789579095.313013:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789579095.313050:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17136:1876509277192832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.313095:0:17136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.313110:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579095.313161:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192832 00000100:00100000:3.0:1789579095.313168:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192832 00000100:00100000:3.0:1789579095.313211:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579095.313220:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+9:17136:x1876509277192832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579095.313330:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+9:17136:x1876509277192832:12345-0@lo:502:llog_process_th.0 Request processed in 111us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579095.313337:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789579095.313448:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17136:1876509277192832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789579095.313469:0:17136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579095.313473:0:17136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579095.313474:0:17136:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789579095.313478:0:17136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789579095.313718:0:17097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789579095.313747:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789579095.313767:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.313778:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437400/0xd90373d592f21e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21e0e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579095.313787:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939304130800 from 1 10000000:01000000:1.0:1789579095.313789:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579095.313821:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.313829:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.313837:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.313852:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579095.313895:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.313916:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.314074:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277192960 00000100:00100000:0.0:1789579095.314080:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277192960 00000100:00100000:0.0:1789579095.314139:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789579095.314146:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+9:17097:x1876509277192960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579095.314163:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579095.314178:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21e9a expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.314199:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21e9a expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.314209:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21e9a expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.314218:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437000, rc 0) 00000100:00100000:0.0:1789579095.314256:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+10:17097:x1876509277192960:12345-0@lo:101:mount.lustre.0 Request processed in 111us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.314262:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579095.314316:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277192960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579095.314329:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.314338:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.314827:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789579095.315077:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.315165:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579095.315200:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193088 00000100:00100000:3.0:1789579095.315204:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193088 00000100:00100000:3.0:1789579095.315225:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579095.315231:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+10:17097:x1876509277193088:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789579095.315244:0:17112:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789579095.315250:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789579095.315512:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+10:17097:x1876509277193088:12345-0@lo:256:mount.lustre.0 Request processed in 279us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579095.315518:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789579095.315630:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789579095.316186:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579095.316203:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.316213:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579095.316221:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939304130800 from 1 10000000:01000000:1.0:1789579095.316223:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789579095.316247:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.316255:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.316263:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.316278:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579095.316309:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.316468:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.316619:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193216 00000100:00100000:0.0:1789579095.316625:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193216 00000100:00100000:2.0:1789579095.316700:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579095.316710:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+10:17097:x1876509277193216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579095.316720:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579095.316732:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21ea8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.316749:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 11 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.316758:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 11 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.316767:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af800, rc 0) 00000100:00100000:2.0:1789579095.316802:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193216:12345-0@lo:101:mount.lustre.0 Request processed in 95us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579095.316808:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789579095.316888:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579095.316901:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.316923:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.316977:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.316997:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.317017:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579095.317127:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193344 00000100:00100000:3.0:1789579095.317132:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193344 00000100:00100000:3.0:1789579095.317163:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579095.317170:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579095.317301:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193344:12345-0@lo:501:mount.lustre.0 Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579095.317316:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579095.317394:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.317430:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579095.317464:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.317490:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579095.317652:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193472 00000100:00100000:3.0:1789579095.317657:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193472 00000100:00100000:3.0:1789579095.317676:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579095.317681:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579095.317766:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193472:12345-0@lo:503:mount.lustre.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579095.317774:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789579095.317960:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579095.318772:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17146:1876509277193600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579095.318821:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579095.318957:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579095.318995:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193600 00000100:00100000:2.0:1789579095.319001:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193600 00000100:00100000:2.0:1789579095.319084:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789579095.319094:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+11:17146:x1876509277193600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789579095.319748:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+11:17146:x1876509277193600:12345-0@lo:502:llog_process_th.0 Request processed in 654us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579095.319757:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579095.319932:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17146:1876509277193600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789579095.319961:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579095.319971:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.319974:0:17146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789579095.319981:0:17146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939304130800 00000020:00000080:3.0:1789579095.319983:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579095.319991:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579095.319994:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.319995:0:17146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789579095.319998:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579095.320000:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.320002:0:17146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789579095.320005:0:17146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff939304130800 00000020:00000080:3.0:1789579095.320007:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579095.320115:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579095.320119:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.320121:0:17146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789579095.320130:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579095.320133:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.320134:0:17146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789579095.320138:0:17146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939304130800 00000020:00000080:3.0:1789579095.320140:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579095.327537:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579095.327550:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.327553:0:17146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789579095.327556:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579095.327573:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.327575:0:17146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789579095.327580:0:17146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939304130800 00000020:00000080:3.0:1789579095.327582:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789579095.327668:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17146:1876509277193728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789579095.327738:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579095.334557:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.334818:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193728 00000100:00100000:0.0:1789579095.334828:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193728 00000100:00100000:0.0:1789579095.334987:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789579095.334998:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+11:17146:x1876509277193728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.335165:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+11:17146:x1876509277193728:12345-0@lo:502:llog_process_th.0 Request processed in 169us (7426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.335173:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579095.335268:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17146:1876509277193728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789579095.335300:0:17146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579095.335308:0:17146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579095.335310:0:17146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789579095.335314:0:17146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789579095.340528:0:17097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789579095.340631:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789579095.340658:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.340671:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579095.340722:0:17097:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789579095.340725:0:17097:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939304130800 10000000:01000000:1.0:1789579095.340727:0:17097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939304130800 10000000:01000000:1.0:1789579095.340731:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789579095.340735:0:17097:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff939304130800 from 1 10000000:01000000:1.0:1789579095.340738:0:17097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789579095.340770:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.340785:0:17097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.340796:0:17097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.340820:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579095.340954:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.340990:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789579095.341067:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193856 00000100:00100000:2.0:1789579095.341074:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193856 00000100:00100000:2.0:1789579095.341117:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789579095.341126:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+11:17097:x1876509277193856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579095.341138:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579095.341150:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363af200/0xd90373d592f21ebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21eb6 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.341173:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af200/0xd90373d592f21ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21eb6 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.341183:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363af200/0xd90373d592f21ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21eb6 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.341191:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af200, rc 0) 00000100:00100000:2.0:1789579095.341228:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277193856:12345-0@lo:101:mount.lustre.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579095.341234:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789579095.341311:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579095.341325:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.341335:0:17097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.341722:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.341750:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.341781:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.341818:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277193984 00000100:00100000:0.0:1789579095.341823:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277193984 00000100:00100000:0.0:1789579095.341865:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789579095.341873:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277193984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579095.341987:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277193984:12345-0@lo:501:mount.lustre.0 Request processed in 114us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.342006:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579095.342736:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277193984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579095.342769:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277194112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579095.342813:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.342844:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.344535:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194112 00000100:00100000:0.0:1789579095.344548:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194112 00000100:00100000:0.0:1789579095.344611:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789579095.344620:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277194112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579095.344749:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277194112:12345-0@lo:503:mount.lustre.0 Request processed in 130us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.344756:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789579095.345052:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277194112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579095.355921:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.355999:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.356059:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579095.357987:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194240 00000100:00100000:2.0:1789579095.358001:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194240 00000100:00100000:2.0:1789579095.358068:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579095.358078:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789579095.358235:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194240:12345-0@lo:502:llog_process_th.0 Request processed in 158us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579095.358244:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789579095.358327:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194240:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789579095.358447:0:17151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789579095.358471:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93943bba8000) 00000020:00000080:2.0:1789579095.358494:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789579095.358942:0:17151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939304130800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789579095.358947:0:17151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939304130800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789579095.358950:0:17151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939304130800 4 00010000:00080000:2.0:1789579095.358978:0:17151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302082800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579095.371796:0:17151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789579095.371990:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789579095.372043:0:17151:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579095.372057:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd90373d592f21ecb 00000100:00080000:2.0:1789579095.372068:0:17151:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579095.372079:0:17151:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939302082800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579095.372114:0:17151:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5ca80 x1876509277194368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579095.372160:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277194368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579095.372226:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579095.372304:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194368 00000100:00100000:2.0:1789579095.372311:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194368 00000100:00100000:2.0:1789579095.372344:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579095.372376:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277194368:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789579095.372437:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3614:x1876509277194368:12345-0@lo:38:llog_process_th.0 Request processed in 85us (210us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789579095.372444:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579095.372479:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579095.372486:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302082800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579095.372503:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789579095.372507:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277194368:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789579095.372523:0:17151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789579095.375903:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.375983:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.376019:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194496 00000100:00100000:0.0:1789579095.376026:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194496 00000100:00100000:0.0:1789579095.376074:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789579095.376082:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.376195:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194496:12345-0@lo:502:llog_process_th.0 Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.376203:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789579095.376252:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.376273:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.376314:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.376344:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.376400:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194624 00000100:00100000:0.0:1789579095.376404:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194624 00000100:00100000:0.0:1789579095.376426:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789579095.376432:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789579095.376492:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17151:x1876509277194624:12345-0@lo:502:llog_process_th.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.376498:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789579095.376526:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.376538:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:044b3bf9-43fa-4501-b924-7b81ca047525:17151:1876509277194624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789579095.376556:0:17151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789579095.379300:0:17097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789579095.379341:0:17097:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789579095.379382:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.379395:0:17097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304367e00/0xd90373d592f21eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ebd expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789579095.379447:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789579095.379450:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579095.379452:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579095.379453:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579095.379454:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579095.379456:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579095.379457:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579095.379459:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579095.379461:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579095.379462:0:17097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789579095.379466:0:17097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789579095.379468:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789579095.379470:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579095.379471:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579095.379472:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579095.379473:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579095.379475:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579095.379476:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579095.379477:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579095.379478:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579095.379479:0:17097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789579095.379504:0:17097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789579095.379524:0:17097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277194752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789579095.379599:0:17097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.379638:0:17097:0:(client.c:2716:ptlrpc_set_wait()) set ffff939402b74000 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.379775:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194752 00000100:00100000:0.0:1789579095.379782:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194752 00000100:00100000:0.0:1789579095.379835:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789579095.379844:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277194752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789579095.379871:0:17112:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789579095.379884:0:17112:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789579095.381466:0:17112:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789579095.381478:0:17112:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789579095.381698:0:17134:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789579095.381703:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789579095.381722:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.381738:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.381747:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.381780:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.381802:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.381815:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277194880:0@lo:104: 00000100:00100000:0.0:1789579095.381868:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579095.381930:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409139cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579095.381982:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17097:x1876509277194752:12345-0@lo:253:mount.lustre.0 Request processed in 2139us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.381990:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789579095.382189:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277194880 00000100:00100000:1.0:1789579095.382196:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277194880 00000100:00100000:1.0:1789579095.382237:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789579095.382245:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277194880:12345-0@lo:104: 00010000:00010000:1.0:1789579095.382263:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382318:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789579095.382324:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277194880:12345-0@lo:104: Request processed in 81us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579095.382331:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789579095.382368:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579095.382375:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382382:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579095.382386:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382394:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579095.382400:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579095.382406:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789579095.382431:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382438:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579095.382457:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382463:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366e00/0xd90373d592f21e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ea1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579095.382484:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579095.382486:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579095.382487:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579095.382530:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277195008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579095.382780:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579095.382903:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277194880:0@lo:104: 00010000:00010000:1.0:1789579095.382920:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579095.382953:0:17097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17097:1876509277194752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789579095.382963:0:17097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789579095.382966:0:17097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789579095.382968:0:17097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789579095.382969:0:17097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789579095.382971:0:17097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789579095.382972:0:17097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789579095.382973:0:17097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789579095.382974:0:17097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789579095.382976:0:17097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789579095.382978:0:17097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789579095.382979:0:17097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789579095.382990:0:17097:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789579095.387448:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195008 00000100:00100000:0.0:1789579095.387464:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195008 00010000:00010000:0.0:1789579095.387501:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579095.387538:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579095.387546:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+12:3616:x1876509277195008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579095.388095:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579095.388106:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388122:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388144:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437000/0xd90373d592f21ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21e9a expref: 12 pid: 17111 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388164:0:17103:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388195:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789579095.388216:0:17103:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006513262s 00010000:00010000:0.0:1789579095.388222:0:17103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388229:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388236:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388243:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388249:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579095.388253:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.388262:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.396083:0:17134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579095.396099:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.397989:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.398004:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436a00/0xd90373d592f21ed2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579095.398025:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579095.398144:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+11:3616:x1876509277195008:12345-0@lo:103:ldlm_bl.0 Request processed in 10595us (15579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579095.398154:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579095.398236:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277195008:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789579095.400809:0:17097:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789579095.401083:0:17097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789579095.401322:0:17157:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789579095.401326:0:17157:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789579095.402021:0:17158:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579095.402890:0:17097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789579095.403333:0:17158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579095.405421:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789579095.405497:0:17158:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1789579095.405959:0:17159:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff939303a33b80 x1876509277195136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579095.405972:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000040:01000000:1.0:1789579095.406442:0:17097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789579095.406483:0:17097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789579095.406918:0:17097:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789579095.406926:0:17097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789579095.406963:0:17097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789579095.407950:0:17097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789579095.408503:0:17097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789579095.408532:0:17097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789579095.410453:0:17097:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789579095.412118:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789579095.413790:0:17097:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789579095.413829:0:17097:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd97819cf988 00100000:10000000:1.0:1789579095.413838:0:17097:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789579095.414969:0:17097:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789579095.414986:0:17097:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789579095.415007:0:17097:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789579095.415024:0:17097:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789579095.415939:0:17097:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579095.416155:0:17097:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789579095.971667:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789579096.355462:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789579096.355469:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939304130800 from 7 10000000:01000000:1.0:1789579096.355473:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579096.355517:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579096.355529:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579096.355541:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579096.355571:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277195264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579096.355637:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579096.355698:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff93942ef583c0 going to sleep for 11 seconds 00000040:00080000:2.0:1789579096.356077:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789579096.356880:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195264 00000100:00100000:3.0:1789579096.356890:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195264 00000100:00100000:3.0:1789579096.356955:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789579096.356964:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+11:17115:x1876509277195264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579096.356986:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579096.357001:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21ed9 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579096.357032:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579096.357042:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579096.357051:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7600, rc 0) 00000100:00100000:3.0:1789579096.357111:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17115:x1876509277195264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579096.357117:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789579096.357298:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277195264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579096.357314:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579096.357322:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579096.357416:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277195392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789579096.357450:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579096.357475:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789579096.357583:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195392 00000100:00100000:1.0:1789579096.357588:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195392 00000100:00100000:1.0:1789579096.357619:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789579096.357626:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:17115:x1876509277195392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789579096.357651:0:17113:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789579096.357665:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789579096.357668:0:17113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789579096.357767:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:17115:x1876509277195392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579096.357773:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789579096.358170:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277195392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789579096.358211:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789579096.358218:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579096.358226:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579096.419660:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789579096.995509:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579097.380136:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789579097.448795:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789579098.034375:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579098.467491:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789579099.044434:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789579099.293416:0:17401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789579099.492275:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789579100.068389:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789579100.134305:0:17454:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579100.134505:0:17454:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1789579100.523471:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789579100.523478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789579100.523481:0:36:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579100.523489:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:0.0:1789579100.523494:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789579100.523504:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579100.523527:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a32d80 x1876509277195648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579100.523543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579100.523547:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579100.523549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579100.523552:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579100.523554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789579100.523557:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789579100.523558:0:36:0:(import.c:65:import_set_state_nolock()) ffff939302082800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579100.523563:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939302082800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579100.523575:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a33800 x1876509277195776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579100.523619:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579100.523632:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277195520:0@lo:400:kworker.0 00000100:00100000:0.0:1789579100.523705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579100.523770:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277195648:0@lo:38:kworker.0 00000100:00100000:0.0:1789579100.523801:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579100.523819:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277195776:0@lo:38:kworker.0 00000100:00100000:0.0:1789579100.523845:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579100.523875:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195520 00000100:00100000:0.0:1789579100.523881:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195520 00000100:00100000:0.0:1789579100.523923:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789579100.523931:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:3618:x1876509277195520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579100.524003:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+12:3618:x1876509277195520:12345-0@lo:400:kworker.0 Request processed in 59us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579100.524011:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789579100.524021:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195648 00000100:00100000:0.0:1789579100.524060:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277195520:0@lo:400:kworker.0 00000100:00100000:0.0:1789579100.524103:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195776 00000100:00100000:0.0:1789579100.524107:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195776 00000100:00100000:1.0:1789579100.524113:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195648 00000100:00100000:0.0:1789579100.524130:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579100.524136:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277195776:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789579100.524149:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579100.524157:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277195648:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789579100.524158:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00010000:00020000:1.0:1789579100.524172:0:17124:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:0.0:1789579100.524195:0:17120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd90373d592f21ee7 00000004:00100000:0.0:1789579100.524210:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789579100.524341:0:17120:0:(import.c:65:import_set_state_nolock()) ffff9394069db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579100.524416:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876509277195776:12345-0@lo:38:kworker.0 Request processed in 278us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579100.524423:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789579100.524463:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939303a33800 x1876509277195776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789579100.524482:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789579100.524489:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789579100.524493:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789579100.524495:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302082800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789579100.524500:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876509277195776:0@lo:38:kworker.0 00000100:00100000:2.0:1789579100.527989:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000100:00100000:1.0:1789579100.548853:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277195648:12345-0@lo:38:kworker.0 Request processed in 24690us (25045us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789579100.548867:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789579100.549099:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579100.549105:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579100.549109:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277195648:0@lo:38:kworker.0 00000020:00000004:0.0:1789579100.956751:0:17504:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579100.956901:0:17504:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579101.091540:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579101.539479:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789579102.117842:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579102.563922:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789579103.139534:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579103.595693:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789579104.169841:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579104.614569:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789579105.188445:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579105.636487:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000100:00100000:0.0:1789579105.636666:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579095/real 1789579095] req@ffff939303a31500 x1876509277192704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579105.636702:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939303a31500 x1876509277192704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579105.636712:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579095/real 1789579095] req@ffff939303a30380 x1876509277192576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579105.636722:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939303a30380 x1876509277192576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789579105.636739:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579105.636747:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789579105.636750:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192704:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789579105.636756:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579105.636759:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789579105.636779:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277192576:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789579105.636989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579105.636994:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579105.636997:0:36:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579105.637002:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789579105.637008:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579105.637018:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579105.637039:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489e300 x1876509277196032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579105.637063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579105.637066:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579105.637067:0:36:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579105.637070:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789579105.637073:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579105.637078:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939407190000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579105.637091:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489e680 x1876509277196160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579105.637099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579105.637101:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579105.637103:0:36:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579105.637106:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789579105.637108:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789579105.637112:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939402ad9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579105.637121:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489d180 x1876509277196288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579105.637161:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277196416:0@lo:400:kworker.0 00000100:00100000:3.0:1789579105.637222:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579105.637304:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196416 00000100:00100000:3.0:1789579105.637312:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196416 00000100:00100000:3.0:1789579105.637379:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579105.637388:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277196416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579105.637438:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277196416:12345-0@lo:400:kworker.0 Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579105.637470:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789579105.637519:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93930489f100 x1876509277196416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579105.637531:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277196416:0@lo:400:kworker.0 00000100:00100000:3.0:1789579105.637550:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196032:0@lo:38:kworker.0 00000100:00100000:3.0:1789579105.637584:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579105.637612:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196160:0@lo:8:kworker.0 00000400:00000100:3.0:1789579105.637637:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277196160 offset 0 length 520: 4 00000100:00100000:3.0:1789579105.637656:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196288:0@lo:8:kworker.0 00000400:00000100:3.0:1789579105.637694:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277196288 offset 0 length 520: 4 00000100:00100000:3.0:1789579105.637721:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196032 00000100:00100000:3.0:1789579105.637725:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196032 00000100:00100000:3.0:1789579105.637746:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579105.637753:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277196032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789579105.637768:0:17123:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789579105.639483:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579105.639506:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277195904:0@lo:400:kworker.0 00000100:00100000:1.0:1789579105.639564:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579105.639622:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195904 00000100:00100000:1.0:1789579105.639628:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195904 00000100:00100000:1.0:1789579105.639665:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579105.639672:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:3617:x1876509277195904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579105.639715:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:3617:x1876509277195904:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579105.639721:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579105.639762:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277195904:0@lo:400:kworker.0 00000100:00100000:3.0:1789579105.651882:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3614:x1876509277196032:12345-0@lo:38:kworker.0 Request processed in 14124us (14291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579105.651908:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789579105.652044:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579105.652050:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579105.652055:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196032:0@lo:38:kworker.0 00010000:00010000:1.0:1789579106.212197:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789579106.626682:0:17848:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789579106.626686:0:17848:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789579106.626688:0:17848:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789579106.626805:0:17848:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93943f640800 00000020:01000004:0.0:1789579106.626821:0:17848:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789579106.626832:0:17848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789579106.626845:0:17848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff939303570000) 00000020:00000080:0.0:1789579106.626860:0:17848:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1789579106.667596:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00100000:10000000:1.0:1789579106.675385:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.676258:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789579106.677749:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.678209:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.678616:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.678871:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.679084:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.679287:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.679781:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.679960:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.680130:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.680305:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.680694:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.680875:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.681054:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.681616:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.681795:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.681979:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.682186:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.682698:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.682883:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.683064:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.683269:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.683627:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.683912:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.684092:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.684267:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.684590:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.684935:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.685112:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.685286:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.685630:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789579106.685902:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.686134:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789579106.690107:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789579106.690733:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789579106.690979:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789579106.691160:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789579106.691335:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789579106.691766:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789579106.692019:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789579106.692210:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789579106.692750:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789579106.693018:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789579106.693167:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789579106.693312:0:17848:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1789579106.694297:0:17848:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789579106.694762:0:17848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789579106.694773:0:17848:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789579106.694784:0:17848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21ef5 00000020:01000004:0.0:1789579106.694792:0:17848:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789579106.694823:0:17848:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789579106.694827:0:17848:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789579106.694834:0:17848:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789579106.694858:0:17848:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789579106.694862:0:17848:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789579106.703025:0:17848:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789579106.703072:0:17848:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789579106.703076:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789579106.703082:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.703083:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.703084:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.703086:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.703087:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.703088:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579106.703090:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.703091:0:17848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579106.703094:0:17848:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789579106.703096:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579106.703097:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.703098:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.703099:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.703100:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.703101:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.703102:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579106.703103:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.703104:0:17848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579106.703130:0:17848:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789579106.703148:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579106.703216:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.703267:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579106.703570:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196544 00000100:00100000:3.0:1789579106.703579:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196544 00000100:00100000:3.0:1789579106.703840:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789579106.703850:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17848:x1876509277196544:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789579106.703883:0:17111:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789579106.703887:0:17111:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789579106.703901:0:17111:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789579106.704555:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17848:x1876509277196544:12345-0@lo:253:mount.lustre.0 Request processed in 704us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.704563:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579106.705110:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579106.705125:0:17848:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789579106.705128:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579106.705130:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.705131:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.705133:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.705134:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.705135:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.705136:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579106.705138:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.705140:0:17848:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789579106.705157:0:17848:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93943f640800 from lustre-MDT0001 10000000:01000000:0.0:1789579106.705256:0:17848:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789579106.705260:0:17848:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789579106.705266:0:17848:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93943f544d40 local copy 00010000:00010000:0.0:1789579106.705283:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579106.705417:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579106.705454:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.708211:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789579106.711720:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196672 00000100:00100000:1.0:1789579106.711734:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196672 00000100:00100000:0.0:1789579106.712503:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579106.712514:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17848:x1876509277196672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579106.712648:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+12:17848:x1876509277196672:12345-0@lo:501:mount.lustre.0 Request processed in 135us (7193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789579106.712655:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579106.712801:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789579106.712824:0:17848:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789579106.712853:0:17848:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789579106.712862:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.712874:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.712915:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93943f640800 10000000:01000000:1.0:1789579106.712920:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789579106.712924:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93943f544d40 10000000:01000000:1.0:1789579106.712927:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789579106.712930:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93943f544d40 from 1 10000000:01000000:1.0:1789579106.712933:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789579106.712974:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.712982:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.712991:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.713009:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579106.713043:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.713078:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579106.713134:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196800 00000100:00100000:3.0:1789579106.713140:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196800 00000100:00100000:3.0:1789579106.713162:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789579106.713169:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+12:17848:x1876509277196800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579106.713177:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579106.713191:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c6a00/0xd90373d592f21f03 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21efc expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713210:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c6a00/0xd90373d592f21f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21efc expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713220:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c6a00/0xd90373d592f21f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21efc expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713228:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6a00, rc 0) 00000100:00100000:3.0:1789579106.713266:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+13:17848:x1876509277196800:12345-0@lo:101:mount.lustre.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.713272:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579106.713380:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579106.713392:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.713400:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.713414:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789579106.713424:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.713441:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366000/0xd90373d592f21efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f03 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.713448:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93943f640800 10000000:01000000:1.0:1789579106.713451:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789579106.713454:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93943f640800 from 1 10000000:01000000:1.0:1789579106.713456:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789579106.713470:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.713487:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.713495:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.713506:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579106.713530:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.713543:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579106.713694:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277196928 00000100:00100000:3.0:1789579106.713699:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277196928 00000100:00100000:3.0:1789579106.713717:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789579106.713723:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+13:17848:x1876509277196928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579106.713730:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579106.713737:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7400/0xd90373d592f21f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21f0a expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713760:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7400/0xd90373d592f21f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21f0a expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713768:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7400/0xd90373d592f21f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21f0a expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.713774:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7400, rc 0) 00000100:00100000:3.0:1789579106.713808:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+14:17848:x1876509277196928:12345-0@lo:101:mount.lustre.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.713815:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579106.713967:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277196928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579106.713977:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.713984:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.713994:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789579106.714009:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.714022:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366600/0xd90373d592f21f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f11 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.714028:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789579106.714031:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789579106.714036:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93943f640800 10000000:01000000:1.0:1789579106.714038:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789579106.714041:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789579106.714043:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789579106.714055:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.714062:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.714069:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.714080:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579106.714102:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.714129:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579106.714199:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197056 00000100:00100000:0.0:1789579106.714203:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197056 00000100:00100000:0.0:1789579106.714231:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789579106.714237:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+14:17848:x1876509277197056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579106.714244:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579106.714252:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436e00/0xd90373d592f21f1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21f18 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.714264:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436e00/0xd90373d592f21f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21f18 expref: 15 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.714272:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436e00/0xd90373d592f21f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21f18 expref: 15 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.714278:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436e00, rc 0) 00000100:00100000:0.0:1789579106.714314:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197056:12345-0@lo:101:mount.lustre.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579106.714330:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789579106.714456:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579106.714467:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.714537:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579106.715674:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789579106.718914:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579106.723303:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789579106.723613:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789579106.723632:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789579106.723644:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789579106.723655:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789579106.723666:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789579106.723677:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789579106.723688:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789579106.723700:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789579106.723722:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789579106.723733:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789579106.723747:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789579106.724046:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789579106.724065:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789579106.724079:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789579106.724092:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789579106.724104:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789579106.724117:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789579106.724129:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789579106.724141:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789579106.724238:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789579106.724255:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789579106.724267:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789579106.724292:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789579106.724298:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789579106.725087:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579106.725144:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.725217:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95000 going to sleep for 11 seconds 00000100:00100000:0.0:1789579106.725258:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197184 00000100:00100000:0.0:1789579106.725265:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197184 00000100:00100000:0.0:1789579106.725393:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789579106.725401:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579106.725541:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197184:12345-0@lo:501:mount.lustre.0 Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579106.725549:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579106.725688:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579106.725720:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579106.725758:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.725937:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95000 going to sleep for 11 seconds 00000100:00100000:1.0:1789579106.725972:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197312 00000100:00100000:1.0:1789579106.725977:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197312 00000100:00100000:1.0:1789579106.726001:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579106.726007:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579106.726980:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197312:12345-0@lo:503:mount.lustre.0 Request processed in 969us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.727002:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579106.727072:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579106.727670:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579106.727736:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579106.727779:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.727847:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95180 going to sleep for 11 seconds 00000100:00100000:0.0:1789579106.727885:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197440 00000100:00100000:0.0:1789579106.727891:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197440 00000100:00100000:0.0:1789579106.727972:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789579106.727981:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579106.728610:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197440:12345-0@lo:502:mount.lustre.0 Request processed in 630us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579106.728619:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579106.728688:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579106.728850:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789579106.728877:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789579106.728892:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789579106.728905:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789579106.728917:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789579106.728929:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789579106.728941:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789579106.728970:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789579106.728984:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789579106.728997:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789579106.729010:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789579106.729023:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789579106.729036:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789579106.729048:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789579106.729060:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789579106.729073:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789579106.729087:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789579106.729099:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789579106.729111:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789579106.729123:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789579106.729136:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789579106.729148:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789579106.729159:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789579106.729172:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789579106.729184:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789579106.729197:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789579106.729210:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789579106.729222:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789579106.729235:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789579106.729247:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789579106.729260:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789579106.729284:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789579106.729298:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789579106.729310:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789579106.729323:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789579106.729334:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789579106.729377:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789579106.729393:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789579106.729405:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789579106.729417:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789579106.729429:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789579106.729441:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789579106.729453:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789579106.729467:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789579106.729506:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579106.729548:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.729705:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95180 going to sleep for 11 seconds 00000100:00100000:1.0:1789579106.729793:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197568 00000100:00100000:1.0:1789579106.729800:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197568 00000100:00100000:1.0:1789579106.729832:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789579106.729840:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579106.729984:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277197568:12345-0@lo:502:mount.lustre.0 Request processed in 143us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.729990:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789579106.730074:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277197568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579106.730113:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789579106.730122:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789579106.730849:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579106.730861:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579106.730863:0:17853:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789579106.730869:0:17853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789579106.730872:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789579106.730885:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93942edf99c0) 00000020:00000080:1.0:1789579106.730904:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789579106.730909:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789579106.731031:0:17853:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789579106.731039:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21f2d 00000020:00000080:1.0:1789579106.731240:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789579106.731245:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579106.731248:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579106.731250:0:17853:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789579106.731253:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579106.731256:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579106.731258:0:17853:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789579106.731262:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789579106.731269:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93942edfcd40) 00000020:00000080:1.0:1789579106.731280:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789579106.731284:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789579106.731286:0:17853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789579106.731294:0:17853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789579106.731300:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789579106.731624:0:17853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943f640800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789579106.731647:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93943bb3b380) 00000020:00000080:1.0:1789579106.731657:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789579106.731720:0:17853:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789579106.731725:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f21f42 00000020:00000080:1.0:1789579106.731819:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789579106.731826:0:17853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789579106.731830:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd90373d592f21f49 00080000:01000000:1.0:1789579106.731836:0:17853:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789579106.731839:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21f50 00010000:00010000:0.0:1789579106.816900:0:17853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789579106.817777:0:17853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789579106.818048:0:17853:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789579106.819079:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789579106.819091:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579106.819097:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579106.819099:0:17853:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789579106.819102:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579106.819107:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579106.819108:0:17853:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789579106.819112:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789579106.819116:0:17853:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:00000080:1.0:1789579106.819141:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789579106.819155:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93943bb399c0) 00000020:00000080:1.0:1789579106.819173:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789579106.819178:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789579106.819234:0:17853:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789579106.819240:0:17853:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789579106.819247:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21f5e 00010000:00080000:1.0:1789579106.819276:0:17853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939432173000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579106.820897:0:17853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789579106.838557:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789579106.838570:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789579106.838609:0:17853:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789579106.838629:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f21f65 00000100:00080000:3.0:1789579106.838639:0:17853:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789579106.838650:0:17853:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939432173000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579106.838681:0:17853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489fb80 x1876509277197696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579106.838708:0:17853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579106.838741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579106.838754:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579106.838756:0:36:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579106.838760:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1789579106.838763:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789579106.838768:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579106.838779:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489c700 x1876509277197824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579106.838789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.838792:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.838795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.838797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579106.838829:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277197952:0@lo:400:kworker.0 00000100:00100000:3.0:1789579106.838879:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.838936:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197952 00000100:00100000:3.0:1789579106.838942:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197952 00000100:00100000:3.0:1789579106.838991:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579106.838999:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277197952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579106.839039:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277197952:12345-0@lo:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.839046:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789579106.839076:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93930489ca80 x1876509277197952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579106.839088:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277197952:0@lo:400:kworker.0 00000020:01000000:3.0:1789579106.839129:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579106.839140:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839142:0:17853:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789579106.839145:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579106.839147:0:17853:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789579106.839149:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579106.839150:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579106.839152:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579106.839153:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839155:0:17853:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579106.839157:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579106.839160:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839162:0:17853:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789579106.839165:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789579106.839192:0:17853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789579106.839204:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579106.839206:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839207:0:17853:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789579106.839209:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789579106.839211:0:17853:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789579106.839212:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579106.839213:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789579106.839215:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789579106.839217:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839218:0:17853:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789579106.839220:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579106.839222:0:17853:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789579106.839225:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579106.839226:0:17853:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789579106.839228:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789579106.839232:0:17853:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:3.0:1789579106.839248:0:17853:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789579106.839251:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579106.839262:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93943f543380) 00000020:00000080:3.0:1789579106.839273:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789579106.839280:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789579106.839338:0:17853:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789579106.839344:0:17853:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789579106.839366:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21f73 00010000:00080000:3.0:1789579106.839391:0:17853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939302b3b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.137@tcp at head 00000100:00100000:1.0:1789579106.839615:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277197696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579106.839648:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.839681:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277197824:0@lo:38:kworker.0 00000100:00100000:1.0:1789579106.839701:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.839732:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197696 00000100:00100000:1.0:1789579106.839735:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197696 00000100:00100000:1.0:1789579106.839747:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277197824 00000100:00100000:1.0:1789579106.839749:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277197824 00000100:00100000:1.0:1789579106.839757:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579106.839762:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277197696:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789579106.839779:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1789579106.839804:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f21f7a 00000004:00100000:1.0:1789579106.839815:0:17124:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789579106.839820:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1789579106.840633:0:17853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1789579106.841293:0:17853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579106.845091:0:17853:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789579106.854048:0:17124:0:(import.c:65:import_set_state_nolock()) ffff939303a21800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579106.854139:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277197696:12345-0@lo:38:llog_process_th.0 Request processed in 14373us (14488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.854148:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579106.854176:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579106.854182:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277197824:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789579106.854220:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277197824:12345-0@lo:38:kworker.0 Request processed in 37us (14518us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789579106.854226:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579106.854297:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579106.854306:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789579106.854315:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789579106.854321:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789579106.854323:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939432173000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789579106.854370:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277197696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579106.854384:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579106.854388:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579106.854392:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789579106.854394:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277197824:0@lo:38:kworker.0 00000040:00080000:0.0:1789579106.854518:0:17853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579106.854676:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789579106.854690:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277198080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579106.854732:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.854799:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198080 00000100:00100000:3.0:1789579106.854810:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198080 00000040:00080000:2.0:1789579106.854829:0:17853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1789579106.854851:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789579106.854857:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277198080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579106.854877:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789579106.854917:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277198080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.854923:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789579106.854981:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277198080:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789579106.854991:0:17853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789579106.855996:0:17858:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789579106.856001:0:17858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789579106.856654:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789579106.856666:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789579106.856699:0:17853:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789579106.856717:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f21f81 00000100:00080000:2.0:1789579106.856726:0:17853:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579106.856736:0:17853:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b3b800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579106.856763:0:17853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5d880 x1876509277198208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579106.856791:0:17853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789579106.856879:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.856883:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.856884:0:17853:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789579106.856887:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789579106.856890:0:17853:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1789579106.856892:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789579106.856893:0:17853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789579106.856895:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789579106.856897:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.856899:0:17853:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789579106.856901:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789579106.856905:0:17853:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789579106.856909:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.856911:0:17853:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789579106.856914:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789579106.856917:0:17853:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.137@tcp to nid 0x20000c0a8cb89 (192.168.203.137@tcp) 00000020:01000000:2.0:1789579106.856933:0:17853:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789579106.856936:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789579106.856962:0:17853:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93943bbab380) 00000020:00000080:2.0:1789579106.856973:0:17853:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789579106.856980:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1789579106.856990:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277198208:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789579106.857026:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277198208 offset 0 length 520: 4 00000004:00080000:2.0:1789579106.857042:0:17853:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789579106.857048:0:17853:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789579106.857053:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd90373d592f21f8f 00010000:00080000:2.0:1789579106.857078:0:17853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939436236000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579106.857258:0:17853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789579106.857322:0:17853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579106.857335:0:17853:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789579106.863359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.863368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.863371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.863374:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789579106.864822:0:17853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579106.865100:0:17853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789579106.865209:0:17853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789579106.865703:0:17860:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789579106.865713:0:17860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789579106.866497:0:17853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789579106.866518:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789579106.866568:0:17853:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789579106.866594:0:17853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f21f96 00000100:00080000:2.0:1789579106.866606:0:17853:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579106.866624:0:17853:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579106.866675:0:17853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5ca80 x1876509277198336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579106.866709:0:17853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789579106.866783:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.866791:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.866792:0:17853:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789579106.866799:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.866810:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.866811:0:17853:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789579106.866818:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789579106.866819:0:17853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789579106.866824:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.866839:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.866841:0:17853:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789579106.866847:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.866853:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.866854:0:17853:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789579106.866861:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789579106.866897:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1789579106.866902:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277198336:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1789579106.866903:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.866904:0:17853:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789579106.866910:0:17853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000400:00000100:1.0:1789579106.866965:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277198336 offset 0 length 520: 4 00000100:00080000:3.0:1789579106.867238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.867246:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.867248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.867254:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789579106.867284:0:17848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789579106.867334:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789579106.867541:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.867558:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366200/0xd90373d592f21f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21f1f expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579106.867571:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f640800 from 1 10000000:01000000:3.0:1789579106.867574:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579106.867677:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.867691:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.867711:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579106.867774:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579106.867935:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.868074:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579106.868199:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198464 00000100:00100000:1.0:1789579106.868207:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198464 00000100:00100000:1.0:1789579106.868256:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789579106.868265:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+15:17848:x1876509277198464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579106.868278:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579106.868290:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21f9d expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.868312:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21f9d expref: 16 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.868321:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21f9d expref: 16 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.868328:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366c00, rc 0) 00000100:00100000:1.0:1789579106.868618:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+16:17848:x1876509277198464:12345-0@lo:101:mount.lustre.0 Request processed in 352us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.868625:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579106.868855:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579106.868870:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.868891:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579106.869486:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198592:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789579106.869528:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.869556:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394291923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.869817:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198592 00000100:00100000:2.0:1789579106.869824:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198592 00000100:00100000:2.0:1789579106.869855:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789579106.869863:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+16:17848:x1876509277198592:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789579106.869877:0:17113:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789579106.869894:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789579106.869897:0:17113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789579106.870002:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+16:17848:x1876509277198592:12345-0@lo:256:mount.lustre.0 Request processed in 139us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.870009:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789579106.870012:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198592:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789579106.870667:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579106.870691:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.870703:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579106.870711:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f640800 from 1 10000000:01000000:1.0:1789579106.870743:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789579106.870770:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.870777:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.870786:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.870916:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579106.870961:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.870993:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579106.871426:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198720 00000100:00100000:0.0:1789579106.871433:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198720 00000100:00100000:0.0:1789579106.871500:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789579106.871509:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+16:17848:x1876509277198720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579106.871518:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579106.871530:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21fab expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.871551:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21fab expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.871560:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21fab expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.871567:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437c00, rc 0) 00000100:00100000:0.0:1789579106.871613:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277198720:12345-0@lo:101:mount.lustre.0 Request processed in 105us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579106.871619:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579106.871691:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579106.871704:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.871714:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789579106.871961:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789579106.871995:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579106.872020:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.878177:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.878322:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198848 00000100:00100000:2.0:1789579106.878331:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198848 00000100:00100000:2.0:1789579106.878410:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789579106.878420:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277198848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579106.878558:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277198848:12345-0@lo:501:mount.lustre.0 Request processed in 138us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.878565:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579106.878678:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579106.878724:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579106.878834:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.878860:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.878909:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277198976 00000100:00100000:2.0:1789579106.878913:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277198976 00000100:00100000:2.0:1789579106.878942:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789579106.878964:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277198976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579106.879043:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277198976:12345-0@lo:503:mount.lustre.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.879050:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579106.879157:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277198976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789579106.879516:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789579106.879593:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579106.879629:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.879647:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.879716:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199104 00000100:00100000:2.0:1789579106.879721:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199104 00000100:00100000:2.0:1789579106.879741:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789579106.879747:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277199104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579106.880012:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277199104:12345-0@lo:502:mount.lustre.0 Request processed in 264us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.880019:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579106.881906:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579106.882184:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789579106.882210:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789579106.882220:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789579106.882230:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789579106.882239:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789579106.882248:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789579106.882258:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789579106.882269:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789579106.882279:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789579106.882289:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789579106.882298:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789579106.882325:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579106.882399:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.882443:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359480 going to sleep for 11 seconds 00000100:00100000:0.0:1789579106.882557:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199232 00000100:00100000:0.0:1789579106.882564:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199232 00000100:00100000:3.0:1789579106.882603:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789579106.882615:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277199232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579106.882726:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+17:17848:x1876509277199232:12345-0@lo:502:mount.lustre.0 Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.882773:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579106.882810:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789579106.882817:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789579106.884728:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.884740:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884743:0:17862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789579106.884750:0:17862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943f640800 00000020:00000080:2.0:1789579106.884753:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579106.884761:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.884763:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884764:0:17862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789579106.884766:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.884768:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884768:0:17862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789579106.884771:0:17862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93943f640800 00000020:00000080:2.0:1789579106.884773:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579106.884832:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.884836:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884837:0:17862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789579106.884840:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.884843:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884844:0:17862:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789579106.884857:0:17862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943f640800 00000020:00000080:2.0:1789579106.884859:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579106.884876:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.884878:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884879:0:17862:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789579106.884882:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579106.884884:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884885:0:17862:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789579106.884888:0:17862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93943f640800 00000020:00000080:2.0:1789579106.884889:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789579106.884910:0:17862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579106.884913:0:17862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579106.884914:0:17862:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789579106.884917:0:17862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789579106.892426:0:17848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789579106.892469:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789579106.892491:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.892503:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579106.892556:0:17848:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789579106.892559:0:17848:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93943f640800 10000000:01000000:0.0:1789579106.892562:0:17848:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93943f640800 10000000:01000000:0.0:1789579106.892566:0:17848:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579106.892570:0:17848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93943f640800 from 1 10000000:01000000:0.0:1789579106.892573:0:17848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789579106.892605:0:17848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.892613:0:17848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.892622:0:17848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579106.892644:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579106.892698:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.892730:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.893561:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199360 00000100:00100000:2.0:1789579106.893571:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199360 00000100:00100000:2.0:1789579106.893613:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579106.893622:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579106.893634:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579106.893647:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363ae200/0xd90373d592f21fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21fb9 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.893672:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363ae200/0xd90373d592f21fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21fb9 expref: 19 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.893681:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363ae200/0xd90373d592f21fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21fb9 expref: 19 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.893689:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae200, rc 0) 00000100:00100000:2.0:1789579106.893737:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+19:17848:x1876509277199360:12345-0@lo:101:mount.lustre.0 Request processed in 116us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.893757:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789579106.894689:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579106.894729:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.894750:0:17848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579106.896104:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000040:00080000:0.0:1789579106.898315:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789579106.898634:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579106.898850:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789579106.898874:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789579106.898890:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789579106.898903:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789579106.898932:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789579106.898960:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789579106.898977:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789579106.898988:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789579106.899000:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789579106.899014:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789579106.899026:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789579106.899038:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789579106.899051:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789579106.899064:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789579106.899079:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789579106.899092:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789579106.899111:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789579106.899125:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789579106.899138:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789579106.899152:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789579106.899178:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789579106.899194:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789579106.899207:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789579106.899219:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789579106.899231:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789579106.899241:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789579106.899253:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789579106.899265:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789579106.899283:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789579106.899295:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789579106.899391:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579106.899452:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.899497:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579106.901517:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199488 00000100:00100000:3.0:1789579106.901528:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199488 00000100:00100000:3.0:1789579106.901583:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789579106.901591:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579106.901754:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199488:12345-0@lo:501:mount.lustre.0 Request processed in 163us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579106.901768:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579106.901809:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789579106.901811:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579106.901851:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.901888:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579106.902553:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199616 00000100:00100000:3.0:1789579106.902558:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199616 00000100:00100000:3.0:1789579106.902586:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789579106.902593:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579106.902676:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199616:12345-0@lo:503:mount.lustre.0 Request processed in 83us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.902683:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789579106.902684:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579106.904490:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579106.904586:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579106.904656:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.904728:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941ab633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.907980:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199744 00000100:00100000:2.0:1789579106.907994:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199744 00000100:00100000:1.0:1789579106.908111:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789579106.908120:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579106.908327:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199744:12345-0@lo:502:mount.lustre.0 Request processed in 207us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.908341:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789579106.908496:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579106.908726:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789579106.908757:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789579106.908772:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789579106.908786:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789579106.908800:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789579106.908829:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789579106.908844:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789579106.908856:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789579106.908869:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789579106.908882:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789579106.908895:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789579106.908906:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789579106.908919:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789579106.908941:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789579106.908969:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789579106.908982:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789579106.908993:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789579106.909003:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789579106.909016:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789579106.909029:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789579106.909041:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789579106.909067:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789579106.909082:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789579106.909094:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789579106.909106:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789579106.909119:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789579106.909129:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789579106.909140:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789579106.909151:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789579106.909163:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789579106.909173:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789579106.909184:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789579106.909195:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789579106.909206:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789579106.909218:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789579106.909230:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789579106.909243:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789579106.909267:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789579106.909281:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789579106.909292:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789579106.909304:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789579106.909317:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789579106.909330:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789579106.909342:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789579106.909381:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789579106.909397:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789579106.909420:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789579106.909433:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789579106.909488:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579106.909540:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.909576:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.909647:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277199872 00000100:00100000:2.0:1789579106.909653:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277199872 00000100:00100000:2.0:1789579106.909684:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789579106.909691:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579106.909787:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277199872:12345-0@lo:502:mount.lustre.0 Request processed in 96us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.909794:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789579106.911411:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277199872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579106.911595:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789579106.911620:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789579106.911650:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277200000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579106.911698:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.911729:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941ab633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.913046:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200000 00000100:00100000:2.0:1789579106.913061:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200000 00000100:00100000:2.0:1789579106.913119:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789579106.913127:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277200000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579106.913242:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277200000:12345-0@lo:502:mount.lustre.0 Request processed in 115us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.913248:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789579106.913527:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277200000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579106.913592:0:17848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789579106.913602:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789579106.915967:0:17867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789579106.915982:0:17867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff939303574d40) 00000020:00000080:0.0:1789579106.916006:0:17867:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789579106.916111:0:17867:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93943f640800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789579106.916115:0:17867:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93943f640800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789579106.916118:0:17867:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93943f640800 3 00010000:00080000:0.0:1789579106.916145:0:17867:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939403c90800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.137@tcp at head 00010000:00010000:0.0:1789579106.921574:0:17867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789579106.921782:0:17867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789579106.921825:0:17867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789579106.921839:0:17867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd90373d592f21fce 00000100:00080000:0.0:1789579106.921847:0:17867:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579106.921858:0:17867:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939403c90800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579106.921888:0:17867:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a33800 x1876509277200128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579106.921911:0:17867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579106.922089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579106.922094:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579106.922097:0:36:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579106.922105:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579106.922121:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489f800 x1876509277200256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579106.922132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.922135:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.922137:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.922139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.922169:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.922172:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579106.922174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579106.922182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579106.922203:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277200384:0@lo:400:kworker.0 00000100:00100000:3.0:1789579106.922260:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.922272:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277200128:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579106.922301:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.922302:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277200512:0@lo:400:kworker.0 00000100:00100000:3.0:1789579106.922325:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.922327:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277200256:0@lo:38:kworker.0 00000100:00100000:1.0:1789579106.922347:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.922379:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200384 00000100:00100000:3.0:1789579106.922386:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200384 00000100:00100000:1.0:1789579106.922393:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200512 00000100:00100000:1.0:1789579106.922396:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200512 00000100:00100000:1.0:1789579106.922414:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200256 00000100:00100000:3.0:1789579106.922416:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200128 00000100:00100000:1.0:1789579106.922416:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200256 00000100:00100000:3.0:1789579106.922418:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200128 00000100:00100000:3.0:1789579106.922427:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579106.922428:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579106.922435:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277200384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579106.922435:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277200512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579106.922491:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277200384:12345-0@lo:400:kworker.0 Request processed in 56us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.922497:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579106.922511:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579106.922515:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277200128:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789579106.922533:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1789579106.922561:0:17120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd90373d592f21fd5 00000004:00100000:3.0:1789579106.922574:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789579106.922599:0:17120:0:(import.c:65:import_set_state_nolock()) ffff939302b3d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579106.923914:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277200512:12345-0@lo:400:kworker.0 Request processed in 1476us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.923923:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789579106.923959:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579106.923963:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277200256:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789579106.926508:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876509277200128:12345-0@lo:38:llog_process_th.0 Request processed in 3983us (4198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.926522:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579106.927459:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277200256:12345-0@lo:38:kworker.0 Request processed in 3490us (5108us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789579106.927470:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:2.0:1789579106.927679:0:17867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789579106.928224:0:17848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789579106.928254:0:17848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789579106.928277:0:17848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579106.928288:0:17848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437800/0xd90373d592f21fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fc0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789579106.928341:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789579106.928344:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.928345:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.928347:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.928368:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.928369:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.928370:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579106.928372:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.928374:0:17848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579106.928378:0:17848:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789579106.928380:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579106.928381:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.928382:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.928383:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.928384:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.928385:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.928386:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789579106.928387:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.928388:0:17848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579106.928412:0:17848:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789579106.928429:0:17848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277200640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579106.928485:0:17848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579106.928514:0:17848:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579106.928655:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200640 00000100:00100000:1.0:1789579106.928662:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200640 00000100:00100000:1.0:1789579106.928819:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789579106.928829:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277200640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789579106.928857:0:17113:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789579106.928870:0:17113:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789579106.930714:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939303a33800 x1876509277200128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579106.930739:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789579106.930749:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789579106.930756:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789579106.930761:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789579106.930764:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939403c90800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789579106.930771:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876509277200128:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789579106.930791:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579106.930795:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789579106.930798:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277200256:0@lo:38:kworker.0 00000100:00100000:3.0:1789579106.931463:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277200512:0@lo:400:kworker.0 00010000:00080000:3.0:1789579106.931559:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93930489d880 x1876509277200384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579106.931568:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277200384:0@lo:400:kworker.0 00000001:00100000:1.0:1789579106.933105:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789579106.933193:0:17113:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789579106.933209:0:17113:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789579106.933300:0:17134:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789579106.933305:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789579106.933323:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933338:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933345:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21f9d expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933375:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933409:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933422:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 18 pid: 17112 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.933435:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277200768:0@lo:104: 00000100:00100000:1.0:1789579106.933490:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579106.933536:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579106.933544:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 18 pid: 17111 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.933552:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277200896:0@lo:104: 00000100:00100000:1.0:1789579106.933572:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579106.933585:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff93943f5493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.933724:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200768 00000100:00100000:2.0:1789579106.933731:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200768 00000100:00100000:2.0:1789579106.933802:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277200896 00000100:00100000:2.0:1789579106.933806:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277200896 00000100:00100000:2.0:1789579106.933821:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789579106.933828:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277200768:12345-0@lo:104: 00010000:00010000:2.0:1789579106.933840:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.933900:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579106.933906:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277200768:12345-0@lo:104: Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.933912:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789579106.933926:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789579106.933931:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277200896:12345-0@lo:104: 00010000:00010000:2.0:1789579106.933939:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.933979:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789579106.933983:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277200896:12345-0@lo:104: Request processed in 52us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.933988:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789579106.934009:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579106.934015:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934022:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579106.934025:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934033:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579106.934041:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579106.934046:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789579106.934083:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934090:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579106.934104:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934110:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f21f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fa4 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934121:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579106.934124:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934129:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579106.934132:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934137:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579106.934143:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579106.934147:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789579106.934157:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934162:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579106.934174:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934189:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f21ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ee0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579106.934201:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579106.934203:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579106.934204:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579106.934233:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277200768:0@lo:104: 00000100:00100000:2.0:1789579106.934241:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277200896:0@lo:104: 00010000:00010000:2.0:1789579106.934257:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579106.934339:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17848:x1876509277200640:12345-0@lo:253:mount.lustre.0 Request processed in 5511us (5852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579106.934347:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789579106.934376:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579106.934387:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277201024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579106.934416:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579106.934457:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277201152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579106.934462:0:17848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:17848:1876509277200640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579106.934477:0:17848:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789579106.934480:0:17848:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579106.934482:0:17848:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789579106.934483:0:17848:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579106.934484:0:17848:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579106.934486:0:17848:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579106.934487:0:17848:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579106.934488:0:17848:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:3.0:1789579106.934489:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1789579106.934490:0:17848:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579106.934491:0:17848:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789579106.934501:0:17848:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789579106.934516:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201024 00000100:00100000:3.0:1789579106.934519:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201024 00010000:00010000:3.0:1789579106.934538:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 18 pid: 17112 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579106.934558:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201152 00000100:00100000:3.0:1789579106.934566:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201152 00010000:00010000:3.0:1789579106.934579:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 19 pid: 17111 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579106.934591:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579106.934596:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277201024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579106.934604:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579106.934608:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 19 pid: 17112 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934617:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 19 pid: 17112 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934629:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304366c00/0xd90373d592f21fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21f9d expref: 19 pid: 17112 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934640:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579106.934664:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+18:3616:x1876509277201024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.934669:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579106.934681:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579106.934686:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+17:3617:x1876509277201152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579106.934693:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579106.934696:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 17 pid: 17111 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934705:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 17 pid: 17111 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934714:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7600/0xd90373d592f21ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21ed9 expref: 17 pid: 17111 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934731:0:17103:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934739:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789579106.934751:0:17103:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006513262s 00010000:00010000:3.0:1789579106.934756:0:17103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934763:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934770:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934777:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934783:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579106.934787:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934795:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934819:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934829:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579106.934859:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+16:3617:x1876509277201152:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579106.934865:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789579106.934887:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277201024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579106.934907:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277201152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789579106.934920:0:17134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934928:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579106.934934:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304367c00/0xd90373d592f21fdc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1789579106.951134:0:17848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789579106.951327:0:17873:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789579106.951331:0:17873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789579106.953272:0:17874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789579106.953385:0:17848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789579106.955510:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.955562:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579106.955583:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2240 going to sleep for 11 seconds 00000040:00080000:0.0:1789579106.955782:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789579106.955937:0:17848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789579106.955986:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789579106.957392:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201280 00000100:00100000:2.0:1789579106.957403:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201280 00000100:00100000:2.0:1789579106.957455:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579106.957466:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.957565:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 102us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.957573:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579106.957618:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201280:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789579106.957650:0:17875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789579106.957685:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.957725:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579106.957744:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201408 00000100:00100000:2.0:1789579106.957747:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201408 00000100:00100000:2.0:1789579106.957764:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579106.957769:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.957848:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.957854:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579106.957870:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.957881:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.957926:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17875:1876509277201536:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.957969:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579106.957996:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201536 00000100:00100000:2.0:1789579106.957999:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201536 00000100:00100000:2.0:1789579106.958018:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579106.958024:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17875:x1876509277201536:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.958051:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17875:x1876509277201536:12345-0@lo:900:lod0001_rec0000.0 Request processed in 27us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.958057:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789579106.958072:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2840 going to sleep for 11 seconds 00010000:00080000:2.0:1789579106.958084:0:17875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939303a5f480 x1876509277201536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579122 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579106.958094:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17875:1876509277201536:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.958126:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.958155:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579106.958172:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201664 00000100:00100000:2.0:1789579106.958175:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201664 00000100:00100000:2.0:1789579106.958191:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579106.958195:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789579106.958230:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17875:x1876509277201664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 34us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579106.958236:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579106.958250:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394079c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789579106.959100:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17875:1876509277201664:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789579106.959144:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789579106.959841:0:17848:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789579106.959853:0:17848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789579106.959927:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579106.964534:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789579106.964608:0:17875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789579106.965606:0:17874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789579106.965673:0:17874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789579106.965678:0:17874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1789579106.967140:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789579106.967555:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789579106.967578:0:17848:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789579106.967789:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789579106.968276:0:17848:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1789579106.970792:0:17848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789579106.980293:0:17848:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789579106.980332:0:17848:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbd9781c7b988 00100000:10000000:2.0:1789579106.980339:0:17848:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789579106.981276:0:17848:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789579106.981312:0:17848:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789579106.981334:0:17848:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789579106.981394:0:17848:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789579106.982266:0:17848:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579106.982521:0:17848:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789579107.237831:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579107.620909:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789579107.689710:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000040:00080000:1.0:1789579108.004251:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789579108.196416:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789579108.196423:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f640800 from 8 10000000:01000000:2.0:1789579108.196427:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789579108.196485:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579108.196506:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579108.196518:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579108.196545:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277201792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579108.196609:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579108.196653:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407830300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579108.196895:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201792 00000100:00100000:0.0:1789579108.196903:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201792 00000100:00100000:0.0:1789579108.197162:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789579108.197172:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+16:17115:x1876509277201792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579108.197185:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579108.197199:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21fe3 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579108.197222:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 17 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579108.197244:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 17 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579108.197254:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789579108.197300:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277201792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579108.197307:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789579108.197479:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277201792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579108.197494:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579108.197504:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579108.197553:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277201920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789579108.197585:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579108.198185:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407830300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579108.202537:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277201920 00000100:00100000:1.0:1789579108.202553:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277201920 00000100:00100000:1.0:1789579108.202601:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789579108.202611:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277201920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789579108.202634:0:17112:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789579108.202653:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789579108.202655:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789579108.202781:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277201920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (5195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579108.202789:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789579108.202855:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277201920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789579108.202907:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579108.202917:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.202928:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579108.202951:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789579108.202955:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939304130800 from 8 10000000:01000000:1.0:1789579108.202963:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579108.202993:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203001:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203011:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579108.203030:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277202048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579108.203061:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579108.203087:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407830300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579108.203100:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202048 00000100:00100000:1.0:1789579108.203104:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202048 00000100:00100000:1.0:1789579108.203122:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789579108.203128:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277202048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579108.203136:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579108.203147:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f21ff1 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203166:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203175:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 18 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203183:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366e00, rc 0) 00000100:00100000:1.0:1789579108.203224:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277202048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579108.203238:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789579108.203341:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277202048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579108.203369:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203378:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579108.203417:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277202176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789579108.203446:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579108.203460:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407830300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579108.203471:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202176 00000100:00100000:1.0:1789579108.203474:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202176 00000100:00100000:1.0:1789579108.203491:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789579108.203496:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277202176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789579108.203506:0:17112:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789579108.203516:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789579108.203519:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789579108.203583:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277202176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579108.203590:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789579108.203617:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277202176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789579108.203645:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579108.203651:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579108.203666:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579108.259644:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579108.707472:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000040:00080000:1.0:1789579109.030338:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579109.284599:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579109.731975:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789579110.314526:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789579110.355235:0:18117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789579110.755962:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789579111.331881:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789579111.379299:0:18169:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579111.380763:0:18169:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789579111.779587:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 0 seconds 00000020:00000004:2.0:1789579112.255005:0:18219:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579112.255181:0:18219:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1789579112.293700:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789579112.293706:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789579112.293710:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579112.293727:0:14907:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939407188000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579112.293748:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489c000 x1876509277202432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579112.293776:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579112.293779:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579112.293782:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579112.293785:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579112.293809:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579112.293812:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579112.293814:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579112.293816:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579112.293856:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277202304:0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.293927:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.293985:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579112.293992:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277202816:0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294018:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579112.294027:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202304 00000100:00100000:2.0:1789579112.294036:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202304 00000100:00100000:3.0:1789579112.294052:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277202432:0@lo:38:kworker.0 00000100:00100000:2.0:1789579112.294096:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579112.294109:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579112.294109:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277202304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294143:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277202560:0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294168:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.294190:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579112.294195:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277202688:0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294218:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579112.294235:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277202304:12345-0@lo:400:kworker.0 Request processed in 129us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.294253:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202816 00000100:00100000:3.0:1789579112.294258:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202816 00000100:00100000:2.0:1789579112.294267:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579112.294307:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202560 00000100:00100000:3.0:1789579112.294312:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202560 00000100:00100000:2.0:1789579112.294328:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202432 00000100:00100000:3.0:1789579112.294332:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579112.294334:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202432 00000100:00100000:3.0:1789579112.294341:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277202816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294615:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277202816:12345-0@lo:400:kworker.0 Request processed in 274us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.294623:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579112.294638:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579112.294645:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277202560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579112.294678:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277202560:12345-0@lo:400:kworker.0 Request processed in 33us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.294684:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789579112.294720:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930489d500 x1876509277202560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579112.294733:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277202560:0@lo:400:kworker.0 00000100:00100000:2.0:1789579112.295172:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202688 00000100:00100000:2.0:1789579112.295178:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202688 00000100:00100000:2.0:1789579112.295202:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579112.295208:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3614:x1876509277202432:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789579112.295233:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1789579112.295266:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f21fff 00000004:00100000:2.0:1789579112.295348:0:17124:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789579112.295378:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1789579112.295525:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930489c380 x1876509277202816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579112.295537:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277202816:0@lo:400:kworker.0 00000100:00100000:2.0:1789579112.295554:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277202304:0@lo:400:kworker.0 00000100:00100000:1.0:1789579112.298834:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579112.298862:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277202944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579112.298960:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.299100:0:17123:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789579112.299110:0:17123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789579112.299423:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277202944 00000100:00100000:3.0:1789579112.299429:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277202944 00000100:00100000:1.0:1789579112.299630:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789579112.299648:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277202688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579112.299720:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3615:x1876509277202688:12345-0@lo:400:kworker.0 Request processed in 73us (5500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579112.299727:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789579112.299758:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579112.299781:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277202944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579112.299806:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579112.299841:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277202944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579112.299847:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579112.299926:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277202944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579112.300074:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277202688:0@lo:400:kworker.0 00000100:00080000:0.0:1789579112.305152:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93940eb0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579112.305290:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277202432:12345-0@lo:38:kworker.0 Request processed in 10080us (11184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579112.305304:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789579112.305430:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789579112.305439:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789579112.305445:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789579112.305464:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407188000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789579112.305482:0:3614:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fa89d1b4): req@ffff939303a33b80 x1876509277195136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579112.305513:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277202432:0@lo:38:kworker.0 00000100:00100000:3.0:1789579112.305613:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.305642:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941016a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579112.305666:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277195136 00000100:00100000:3.0:1789579112.305671:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277195136 00000100:00100000:3.0:1789579112.305713:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579112.305720:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277195136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.305817:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277195136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.305825:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579112.305861:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17159:1876509277195136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789579112.305919:0:17159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789579112.305975:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17159:1876509277203072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.306026:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.306064:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579112.306083:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203072 00000100:00100000:3.0:1789579112.306086:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203072 00000100:00100000:3.0:1789579112.306118:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579112.306125:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277203072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.306257:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277203072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.306264:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579112.306293:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17159:1876509277203072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.306407:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17159:1876509277203200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.306441:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579112.306454:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff939436137900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579112.306470:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203200 00000100:00100000:3.0:1789579112.306474:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203200 00000100:00100000:3.0:1789579112.306489:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579112.306508:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277203200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789579112.306569:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17159:x1876509277203200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579112.306575:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579112.306622:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17159:1876509277203200:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789579112.306679:0:17159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579112.308878:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579112.308894:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277203328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579112.308959:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579112.309000:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203328 00000100:00100000:0.0:1789579112.309006:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203328 00000100:00100000:0.0:1789579112.309044:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789579112.309052:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277203328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579112.309080:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579112.309125:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277203328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579112.309143:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789579112.309184:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277203328:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789579112.310168:0:17159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789579112.310247:0:17159:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1789579112.310263:0:17159:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789579112.359655:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789579113.336485:0:18268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc778215b0 20000000:00000080:3.0:1789579113.336503:0:18268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93942eb2fc00 uarg=0000000000000000 20000000:01000000:3.0:1789579113.336538:0:18268:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789579113.336545:0:18268:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789579113.336549:0:18268:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789579113.338229:0:18269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789579113.338491:0:18268:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789579113.354657:0:18268:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789579113.354688:0:18268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354706:0:18268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 17 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354713:0:18268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21fab expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354720:0:18268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354762:0:18268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 17 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354778:0:18268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 17 pid: 17112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579113.354792:0:18268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18268:1876509277203456:0@lo:104: 00000100:00100000:0.0:1789579113.354861:0:18268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579113.354962:0:18268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 17 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.354970:0:18268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 17 pid: 17113 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579113.355000:0:18268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18268:1876509277203584:0@lo:104: 00000100:00100000:0.0:1789579113.355023:0:18268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579113.361108:0:18268:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407e85600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579113.363905:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203456 00000100:00100000:2.0:1789579113.363921:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203456 00000100:00100000:3.0:1789579113.364024:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203584 00000100:00100000:3.0:1789579113.364029:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203584 00000100:00100000:3.0:1789579113.364138:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579113.364150:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:18268:x1876509277203584:12345-0@lo:104: 00010000:00010000:3.0:1789579113.364167:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579113.364320:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789579113.364327:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:18268:x1876509277203584:12345-0@lo:104: Request processed in 180us (9303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579113.364346:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579113.364416:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789579113.364520:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:18268:x1876509277203456:12345-0@lo:104: 00010000:00010000:3.0:1789579113.364532:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579113.364567:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789579113.364573:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:18268:x1876509277203456:12345-0@lo:104: Request processed in 151us (9714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579113.364580:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789579113.364784:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579113.364792:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364800:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304367200 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579113.364805:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364820:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579113.364827:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579113.364832:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789579113.364878:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364885:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579113.364917:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364925:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304367200/0xd90373d592f21ea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21eaf expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364938:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579113.364941:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364947:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:2.0:1789579113.364950:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.364957:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789579113.364963:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579113.364974:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789579113.364989:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365289:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789579113.365308:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365315:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366800/0xd90373d592f21fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fb2 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365331:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579113.365333:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579113.365335:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579113.365341:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579113.365375:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277203712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579113.365482:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579113.365533:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579113.365552:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277203840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579113.365580:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579113.365627:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203712 00000100:00100000:2.0:1789579113.365632:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203712 00010000:00010000:2.0:1789579113.365654:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 18 pid: 17113 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579113.365673:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203840 00000100:00100000:2.0:1789579113.365676:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203840 00010000:00010000:2.0:1789579113.365688:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 19 pid: 17112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579113.365715:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579113.365722:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277203712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579113.365734:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579113.365739:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 19 pid: 17113 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365749:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 19 pid: 17113 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365764:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579113.365795:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:044b3bf9-43fa-4501-b924-7b81ca047525+19:3616:x1876509277203712:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579113.365802:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579113.365816:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579113.365822:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277203840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789579113.365830:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579113.365834:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 18 pid: 17112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365843:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 18 pid: 17112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365854:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365863:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365888:0:17105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365907:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365915:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365921:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365927:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579113.365931:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365938:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365947:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579113.365957:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579113.365984:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277203840:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579113.366000:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579113.366037:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277203712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789579113.366065:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277203840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579113.367939:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af800/0xd90373d592f21eaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21ea8 expref: 17 pid: 17113 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579113.367959:0:18268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18268:1876509277203584:0@lo:104: 00010000:00010000:0.0:1789579113.367974:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437c00/0xd90373d592f21fb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21fab expref: 16 pid: 17112 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579113.367981:0:18268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18268:1876509277203456:0@lo:104: 00010000:00010000:0.0:1789579113.368258:0:18268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.368269:0:18268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.368275:0:18268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.368280:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303437200/0xd90373d592f22006 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579113.388594:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579114.404254:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789579115.363635:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579115.363643:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f640800 from 13 10000000:01000000:2.0:1789579115.363649:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579115.363696:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579115.363709:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579115.363720:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579115.363745:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277203968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579115.363875:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579115.363920:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579115.363962:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277203968 00000100:00100000:3.0:1789579115.363969:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277203968 00000100:00100000:3.0:1789579115.364014:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789579115.364023:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+16:17115:x1876509277203968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579115.364034:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579115.364047:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2200d expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579115.364068:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2200d expref: 17 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579115.364078:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2200d expref: 17 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579115.364086:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6000, rc 0) 00000100:00100000:3.0:1789579115.364129:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277203968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579115.364151:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789579115.364204:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277203968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579115.364216:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579115.364224:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579115.364279:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579115.364303:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579115.364316:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579115.364329:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204096 00000100:00100000:3.0:1789579115.364332:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204096 00000100:00100000:3.0:1789579115.364390:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789579115.364397:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277204096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579115.364949:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277204096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 551us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579115.364956:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789579115.364987:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579115.365029:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579115.365063:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579115.365083:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302359b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789579115.365094:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204224 00000100:00100000:3.0:1789579115.365098:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204224 00000100:00100000:3.0:1789579115.365120:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579115.365131:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277204224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579115.365209:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277204224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579115.365215:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579115.365251:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789579115.369659:0:18339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579115.369909:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579115.369932:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579115.369943:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579115.369955:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579115.369965:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789579115.369967:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939304130800 from 13 10000000:01000000:2.0:1789579115.369970:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789579115.370004:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579115.370012:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579115.370035:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579115.370059:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789579115.370118:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579115.370151:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939303ae86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579115.370438:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204352 00000100:00100000:0.0:1789579115.370446:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204352 00000100:00100000:0.0:1789579115.370491:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789579115.370500:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+17:17115:x1876509277204352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579115.370521:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579115.370533:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2201b expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579115.370555:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2201b expref: 18 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579115.370565:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2201b expref: 18 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579115.370573:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436200, rc 0) 00000100:00100000:0.0:1789579115.370611:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277204352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579115.370617:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789579115.370658:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579115.370671:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579115.370678:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579115.370729:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579115.370751:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579115.370908:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204480 00000100:00100000:2.0:1789579115.370913:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204480 00000100:00100000:2.0:1789579115.370936:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789579115.370942:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277204480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579115.371036:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277204480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579115.371043:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789579115.371202:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407e85780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579115.371215:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579115.371241:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579115.371282:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579115.371300:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939407e85780 going to sleep for 11 seconds 00000100:00100000:0.0:1789579115.371312:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204608 00000100:00100000:0.0:1789579115.371316:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204608 00000100:00100000:0.0:1789579115.371332:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789579115.371338:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277204608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579115.372075:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:17115:x1876509277204608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 735us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579115.372082:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579115.372200:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277204608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789579115.378986:0:18340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789579115.381092:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789579115.381131:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789579115.381142:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579115.381154:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579115.431861:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579116.388176:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579106/real 1789579106] req@ffff939303a5ca80 x1876509277198336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579116.388229:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939303a5ca80 x1876509277198336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579116.388243:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579106/real 1789579106] req@ffff939303a5d880 x1876509277198208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579116.388257:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939303a5d880 x1876509277198208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789579116.388281:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579116.388316:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789579116.388321:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277198336:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789579116.388328:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579116.388334:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789579116.388338:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277198208:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789579116.388490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579116.388497:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579116.388500:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579116.388504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579116.388519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579116.388523:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789579116.388527:0:36:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579116.388534:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 461 00000100:00080000:1.0:1789579116.388540:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579116.388551:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b3b800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579116.388584:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439a680 x1876509277205248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789579116.388600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579116.388604:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789579116.388606:0:36:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789579116.388613:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 461 00000100:00080000:1.0:1789579116.388617:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789579116.388623:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579116.388628:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277205248:0@lo:8:kworker.0 00000100:00100000:1.0:1789579116.388640:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304399180 x1876509277205376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579116.388688:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277204864:0@lo:400:kworker.0 00000400:00000100:3.0:1789579116.388702:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277205248 offset 0 length 520: 4 00000100:00100000:1.0:1789579116.388826:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579116.388916:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277204992:0@lo:400:kworker.0 00000100:00100000:3.0:1789579116.399492:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277205376:0@lo:8:kworker.0 00000400:00000100:3.0:1789579116.399589:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277205376 offset 0 length 520: 4 00000100:00100000:0.0:1789579116.400941:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277205120:0@lo:400:kworker.0 00000100:00100000:0.0:1789579116.401049:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579116.401245:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204864 00000100:00100000:0.0:1789579116.401253:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204864 00000100:00100000:0.0:1789579116.401377:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277205120 00000100:00100000:0.0:1789579116.404553:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277205120 00000100:00100000:0.0:1789579116.404636:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789579116.404647:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277204864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579116.404736:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277204864:12345-0@lo:400:kworker.0 Request processed in 92us (15910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579116.404743:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789579116.404810:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789579116.404817:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277205120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579116.404918:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277205120:12345-0@lo:400:kworker.0 Request processed in 101us (3869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579116.404925:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789579116.405032:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277205120:0@lo:400:kworker.0 00000100:00100000:0.0:1789579116.405112:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277204864:0@lo:400:kworker.0 00000100:00100000:1.0:1789579116.407820:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579116.409522:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277204736:0@lo:400:kworker.0 00000100:00100000:2.0:1789579116.409663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579116.409719:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277205504:0@lo:400:kworker.0 00000100:00100000:2.0:1789579116.409745:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579116.409803:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204736 00000100:00100000:1.0:1789579116.409811:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204736 00000100:00100000:1.0:1789579116.409858:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789579116.409866:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277204736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579116.409925:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277204736:12345-0@lo:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579116.409932:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789579116.415782:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277204992 00000100:00100000:0.0:1789579116.415797:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277204992 00000100:00100000:1.0:1789579116.415844:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277205504 00000100:00100000:2.0:1789579116.415850:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277204736:0@lo:400:kworker.0 00000100:00100000:1.0:1789579116.415852:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277205504 00000100:00100000:0.0:1789579116.415855:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579116.415865:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277204992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579116.415928:0:17118:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789579116.415937:0:17118:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789579116.415952:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277204992:12345-0@lo:400:kworker.0 Request processed in 87us (26993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579116.415959:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579116.415977:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579116.415983:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277205504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579116.416015:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277205504:12345-0@lo:400:kworker.0 Request processed in 32us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579116.416022:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789579116.416070:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304399c00 x1876509277205504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579116.416083:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277205504:0@lo:400:kworker.0 00010000:00080000:1.0:1789579116.416085:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930439b100 x1876509277204992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579116.416098:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277204992:0@lo:400:kworker.0 00010000:00010000:2.0:1789579116.454497:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579117.411598:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579117.411619:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277205632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579117.411680:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579117.411742:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277205632 00000100:00100000:1.0:1789579117.411749:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277205632 00000100:00100000:1.0:1789579117.411795:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789579117.411803:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277205632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579117.411834:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579117.411887:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277205632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579117.411895:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789579117.411952:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277205632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579117.418169:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579117.418191:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277205760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579117.418255:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579117.418297:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277205760 00000100:00100000:3.0:1789579117.418305:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277205760 00000100:00100000:3.0:1789579117.418347:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579117.418379:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277205760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579117.418424:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579117.418469:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277205760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579117.418475:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579117.418520:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277205760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579117.478481:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789579117.860247:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789579117.925243:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789579118.503261:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789579119.269137:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579119.526257:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579120.484530:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579105/real 1789579105] req@ffff93930489e680 x1876509277196160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579120.484564:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930489e680 x1876509277196160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579120.484585:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579105/real 1789579105] req@ffff93930489d180 x1876509277196288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579120.484598:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930489d180 x1876509277196288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579120.484620:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579120.484644:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579120.484649:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196160:0@lo:8:kworker.0 00000100:00080000:1.0:1789579120.484655:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579120.484660:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579120.484663:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277196288:0@lo:8:kworker.0 00000100:00080000:3.0:1789579120.484782:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.484787:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789579120.484790:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579120.484795:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1789579120.484801:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579120.484813:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939407190000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579120.484841:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489e680 x1876509277206144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579120.484864:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.484867:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789579120.484869:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789579120.484872:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1789579120.484875:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789579120.484879:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939402ad9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:3.0:1789579120.484890:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939304197480 x1876509277206272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789579120.484919:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.484923:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579120.484926:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.484929:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579120.484956:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277206016:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485027:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.485081:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789579120.485087:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277205888:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485114:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.485134:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277206656:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485155:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.485177:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277206400:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485196:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.485220:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579120.485225:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277206528:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485243:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.485273:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206016 00000100:00100000:3.0:1789579120.485281:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206016 00000100:00100000:3.0:1789579120.485323:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206528 00000100:00100000:3.0:1789579120.485325:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206528 00000100:00100000:3.0:1789579120.485340:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579120.485370:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277206016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485422:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277206016:12345-0@lo:400:kworker.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.485430:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579120.485446:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579120.485452:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277206528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485477:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277206528:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.485483:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579120.485498:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277205888 00000100:00100000:3.0:1789579120.485501:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277205888 00000100:00100000:3.0:1789579120.485523:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789579120.485529:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277205888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.485554:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+18:3618:x1876509277205888:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.485560:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789579120.485584:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206656 00000100:00100000:3.0:1789579120.485587:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206656 00000100:00100000:3.0:1789579120.485608:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206400 00000100:00100000:3.0:1789579120.485611:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206400 00000100:00100000:1.0:1789579120.486259:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277206144:0@lo:8:kworker.0 00000400:00000100:1.0:1789579120.486300:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277206144 offset 0 length 520: 4 00000100:00100000:1.0:1789579120.486329:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277206272:0@lo:8:kworker.0 00000400:00000100:1.0:1789579120.486376:0:3614:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876509277206272 offset 0 length 520: 4 00000100:00100000:2.0:1789579120.495738:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579120.495767:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277206656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579120.495910:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277206656:12345-0@lo:400:kworker.0 Request processed in 157us (10753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.495933:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579120.495963:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579120.495970:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277206400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579120.496003:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277206400:12345-0@lo:400:kworker.0 Request processed in 34us (10807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.496009:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579120.496057:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277205888:0@lo:400:kworker.0 00010000:00080000:2.0:1789579120.496075:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304195880 x1876509277206656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579120.496089:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277206656:0@lo:400:kworker.0 00000100:00100000:2.0:1789579120.496102:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277206016:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.496386:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277206528:0@lo:400:kworker.0 00010000:00080000:3.0:1789579120.496401:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304195f80 x1876509277206400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579120.496410:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277206400:0@lo:400:kworker.0 00010000:00010000:0.0:1789579120.547615:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789579120.572590:0:18618:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789579120.572595:0:18618:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789579120.572597:0:18618:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789579120.572751:0:18618:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93940f414000 00000020:01000004:0.0:1789579120.572771:0:18618:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789579120.572787:0:18618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789579120.572811:0:18618:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93943615b380) 00000020:00000080:0.0:1789579120.572837:0:18618:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789579120.702318:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789579120.709519:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789579120.716433:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789579120.719023:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789579120.719609:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789579120.719902:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789579120.720213:0:18618:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789579120.721134:0:18618:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789579120.722810:0:18618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789579120.722834:0:18618:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789579120.722932:0:18618:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f22030 00000020:01000004:0.0:1789579120.722945:0:18618:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789579120.722974:0:18618:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789579120.722978:0:18618:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789579120.722986:0:18618:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789579120.722991:0:18618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789579120.723010:0:18618:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93943615cd40) 00000020:00000080:0.0:1789579120.723024:0:18618:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789579120.732076:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579120.732572:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789579120.732579:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789579120.733605:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789579120.733613:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789579120.734553:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789579120.734561:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789579120.746863:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579120.747044:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789579120.747051:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789579120.751002:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789579120.751021:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789579120.796882:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789579120.797132:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789579120.797139:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789579120.802923:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789579120.802942:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789579120.806950:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789579120.806965:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789579120.815882:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789579120.816499:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789579120.816506:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789579120.819658:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789579120.819674:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789579120.855632:0:18618:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789579120.855822:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789579120.855828:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789579120.858736:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789579120.858750:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789579120.865694:0:18618:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789579120.865728:0:18618:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789579120.865734:0:18618:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789579120.885328:0:18618:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789579120.885494:0:18618:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.137@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789579120.885500:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789579120.885502:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789579120.885511:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579120.885512:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579120.885514:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579120.885515:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579120.885516:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579120.885518:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579120.885520:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579120.885525:0:18618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789579120.885528:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579120.885529:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789579120.885530:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579120.885531:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579120.885532:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579120.885678:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579120.885680:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579120.885681:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579120.885682:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789579120.885724:0:18618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789579120.885754:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277206784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579120.885859:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579120.885966:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403def300 going to sleep for 11 seconds 00000100:00100000:1.0:1789579120.895160:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206784 00000100:00100000:1.0:1789579120.895182:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206784 00000100:00100000:1.0:1789579120.895381:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789579120.895397:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:18618:x1876509277206784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789579120.895449:0:17111:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789579120.895454:0:17111:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789579120.895459:0:17111:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789579120.898404:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:18618:x1876509277206784:12345-0@lo:253:mount.lustre.0 Request processed in 3004us (12537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.898419:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789579120.898581:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277206784:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789579120.898597:0:18618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789579120.898600:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789579120.898602:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789579120.898603:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579120.898604:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579120.898605:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579120.898606:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579120.898607:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579120.898608:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579120.898609:0:18618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789579120.898629:0:18618:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93940f414000 from lustre-OST0000 10000000:01000000:0.0:1789579120.898671:0:18618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789579120.898673:0:18618:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789579120.898679:0:18618:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93943f544d40 local copy 00010000:00010000:0.0:1789579120.898687:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579120.898777:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277206912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579120.898804:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.902247:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277206912 00000100:00100000:1.0:1789579120.902260:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277206912 00000100:00100000:1.0:1789579120.902308:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789579120.902317:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:18618:x1876509277206912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579120.902458:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:18618:x1876509277206912:12345-0@lo:501:mount.lustre.0 Request processed in 143us (3653us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789579120.902466:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789579120.902710:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.902732:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277206912:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789579120.902753:0:18618:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789579120.902778:0:18618:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789579120.902786:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.902796:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579120.902826:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93940f414000 10000000:01000000:0.0:1789579120.902831:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789579120.902836:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789579120.902931:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789579120.902937:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789579120.902940:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789579120.902966:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.902974:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.902982:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579120.903018:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579120.903050:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579120.903074:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789579120.903187:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207040 00000100:00100000:1.0:1789579120.903192:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207040 00000100:00100000:1.0:1789579120.903217:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789579120.903223:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+18:18618:x1876509277207040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579120.903231:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579120.903252:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304366800/0xd90373d592f22045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2203e expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.903271:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304366800/0xd90373d592f22045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2203e expref: 19 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.903281:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304366800/0xd90373d592f22045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2203e expref: 19 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.903288:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366800, rc 0) 00000100:00100000:1.0:1789579120.903323:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207040:12345-0@lo:101:mount.lustre.0 Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.903329:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789579120.903614:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579120.903626:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.903635:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579120.904920:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789579120.905657:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579120.908204:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789579120.908753:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789579120.908776:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789579120.908790:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789579120.908803:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789579120.908822:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789579120.908862:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789579120.908872:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789579120.908972:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579120.909033:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.909113:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.909169:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207168 00000100:00100000:0.0:1789579120.909176:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207168 00000100:00100000:0.0:1789579120.909262:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789579120.909272:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579120.909606:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207168:12345-0@lo:501:mount.lustre.0 Request processed in 334us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.909613:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789579120.909821:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579120.909863:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579120.909903:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.909935:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579120.910073:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207296 00000100:00100000:1.0:1789579120.910078:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207296 00000100:00100000:1.0:1789579120.910112:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789579120.910120:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579120.910872:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207296:12345-0@lo:503:mount.lustre.0 Request processed in 751us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.910881:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789579120.911003:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789579120.911785:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789579120.911866:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579120.911914:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.911955:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579120.912064:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207424 00000100:00100000:2.0:1789579120.912070:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207424 00000100:00100000:2.0:1789579120.912111:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789579120.912120:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579120.912790:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207424:12345-0@lo:502:mount.lustre.0 Request processed in 670us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.912799:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789579120.912963:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579120.913147:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789579120.913174:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789579120.913190:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789579120.913214:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789579120.913229:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789579120.913251:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789579120.913265:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789579120.913277:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789579120.913290:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789579120.913303:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789579120.913316:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789579120.913326:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789579120.913660:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579120.913698:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.913720:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789579120.913772:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207552 00000100:00100000:2.0:1789579120.913777:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207552 00000100:00100000:2.0:1789579120.913812:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789579120.913820:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579120.913912:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207552:12345-0@lo:502:mount.lustre.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.913918:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789579120.914014:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579120.914053:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789579120.914061:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789579120.914978:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789579120.914986:0:18635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789579120.914993:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.914995:0:18635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789579120.915000:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789579120.915014:0:18635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93943bba99c0) 00000020:00000080:2.0:1789579120.915034:0:18635:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789579120.915040:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789579120.915117:0:18635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93940f414000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789579120.915125:0:18635:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789579120.915132:0:18635:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd90373d592f22053 00010000:00010000:2.0:1789579120.920733:0:18635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789579120.921119:0:18635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789579120.922771:0:18635:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1789579120.923852:0:18635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789579120.923863:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579120.923868:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923871:0:18635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789579120.923874:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789579120.923876:0:18635:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789579120.923878:0:18635:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789579120.923879:0:18635:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789579120.923881:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789579120.923884:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923890:0:18635:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789579120.923895:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579120.923898:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923899:0:18635:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789579120.923902:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789579120.923904:0:18635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789579120.923906:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579120.923908:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923910:0:18635:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789579120.923913:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789579120.923915:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923916:0:18635:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789579120.923918:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789579120.923940:0:18635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789579120.923943:0:18635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789579120.923944:0:18635:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789579120.923948:0:18635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789579120.928702:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789579120.928747:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789579120.928800:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579120.928813:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303436400/0xd90373d592f2203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22045 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579120.928833:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f414000 from 1 10000000:01000000:3.0:1789579120.928853:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579120.928888:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579120.928896:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579120.928906:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579120.928929:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789579120.928987:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.929028:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579120.929082:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207680 00000100:00100000:2.0:1789579120.929089:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207680 00000100:00100000:2.0:1789579120.929138:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789579120.929147:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+19:18618:x1876509277207680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579120.929159:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579120.929172:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2205a expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579120.929195:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2205a expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579120.929204:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2205a expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579120.929212:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363afa00, rc 0) 00000100:00100000:2.0:1789579120.929265:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277207680:12345-0@lo:101:mount.lustre.0 Request processed in 119us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.929271:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789579120.929540:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579120.929556:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579120.929564:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789579120.930501:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789579120.930710:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789579120.930860:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789579120.930885:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789579120.930901:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789579120.930906:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789579120.930955:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579120.930994:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.931061:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441a3dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579120.931222:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207808 00000100:00100000:2.0:1789579120.931227:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207808 00000100:00100000:2.0:1789579120.931383:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789579120.931391:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277207808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579120.931477:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277207808:12345-0@lo:501:mount.lustre.0 Request processed in 86us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579120.931484:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789579120.931553:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579120.931582:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579120.931619:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.933507:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277207936 00000100:00100000:3.0:1789579120.933521:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277207936 00000100:00100000:3.0:1789579120.933551:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789579120.933559:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277207936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579120.933653:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277207936:12345-0@lo:503:mount.lustre.0 Request processed in 94us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.933660:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789579120.933769:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.933788:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277207936:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579120.934163:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579120.934237:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579120.934284:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579120.934307:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579120.934546:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208064 00000100:00100000:3.0:1789579120.934551:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208064 00000100:00100000:3.0:1789579120.934573:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789579120.934579:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277208064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579120.934654:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277208064:12345-0@lo:502:mount.lustre.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.934662:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789579120.934726:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789579120.934884:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789579120.934907:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789579120.934920:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789579120.934931:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789579120.934943:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789579120.934955:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789579120.934966:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789579120.934978:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789579120.934990:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789579120.935001:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789579120.935015:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789579120.935043:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579120.935073:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579120.935099:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579120.935140:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208192 00000100:00100000:3.0:1789579120.935144:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208192 00000100:00100000:3.0:1789579120.935162:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789579120.935168:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277208192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579120.935490:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277208192:12345-0@lo:502:mount.lustre.0 Request processed in 321us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.935498:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789579120.935700:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579120.935802:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789579120.935811:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789579120.936319:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789579120.936327:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579120.936330:0:18639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789579120.936336:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940f414000 00000020:00000080:0.0:1789579120.936338:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789579120.936345:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789579120.936347:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789579120.936649:0:18639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789579120.936661:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579120.936720:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.936722:0:18639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789579120.936729:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93940f414000 00000020:00000080:1.0:1789579120.936732:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579120.936820:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579120.936824:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.936831:0:18639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789579120.936834:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579120.936837:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.936847:0:18639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789579120.936852:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940f414000 00000020:00000080:1.0:1789579120.936855:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579120.942100:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579120.942112:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.942114:0:18639:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789579120.942120:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579120.942123:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.942125:0:18639:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789579120.942130:0:18639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93940f414000 00000020:00000080:1.0:1789579120.942132:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579120.942198:0:18639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579120.942202:0:18639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579120.942203:0:18639:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789579120.942207:0:18639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789579120.942283:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789579120.942318:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789579120.942332:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.942344:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579120.942625:0:18618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789579120.942629:0:18618:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93940f414000 10000000:01000000:1.0:1789579120.942632:0:18618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93940f414000 10000000:01000000:1.0:1789579120.942636:0:18618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789579120.942641:0:18618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93940f414000 from 1 10000000:01000000:1.0:1789579120.942644:0:18618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789579120.942685:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.942694:0:18618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.942704:0:18618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579120.942727:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789579120.942787:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.942827:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.943316:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208320 00000100:00100000:0.0:1789579120.943324:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208320 00000100:00100000:0.0:1789579120.943718:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789579120.943728:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+20:18618:x1876509277208320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579120.943742:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579120.943755:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437200/0xd90373d592f2206f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22068 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.943778:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437200/0xd90373d592f2206f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22068 expref: 21 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.943789:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437200/0xd90373d592f2206f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22068 expref: 21 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579120.943797:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437200, rc 0) 00000100:00100000:0.0:1789579120.943847:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208320:12345-0@lo:101:mount.lustre.0 Request processed in 112us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.943855:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789579120.943932:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579120.943946:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579120.943954:0:18618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789579120.945237:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789579120.945610:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789579120.945797:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789579120.945821:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789579120.945837:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789579120.945865:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789579120.945877:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789579120.945890:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789579120.945903:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789579120.945915:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789579120.945926:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789579120.945948:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789579120.945960:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789579120.945972:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789579120.945986:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789579120.945999:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789579120.946023:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789579120.946036:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789579120.946048:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789579120.946059:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789579120.946071:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789579120.946083:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789579120.946094:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789579120.946106:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789579120.946119:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789579120.946133:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789579120.946146:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789579120.946158:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789579120.946170:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789579120.946183:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789579120.946194:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789579120.946207:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789579120.946232:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789579120.951060:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789579120.951093:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789579120.951107:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789579120.951120:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789579120.951132:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789579120.951144:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789579120.951170:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789579120.951176:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789579120.951277:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579120.951335:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579120.951547:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208448 00000100:00100000:0.0:1789579120.951555:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208448 00000100:00100000:1.0:1789579120.951575:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209000 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.951602:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789579120.951611:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579120.951735:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208448:12345-0@lo:501:mount.lustre.0 Request processed in 124us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.951742:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789579120.954435:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579120.954485:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579120.954544:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.954589:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209000 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.954693:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208576 00000100:00100000:0.0:1789579120.954699:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208576 00000100:00100000:0.0:1789579120.954747:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789579120.954762:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579120.954874:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208576:12345-0@lo:503:mount.lustre.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.954881:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789579120.955012:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789579120.958203:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789579120.958312:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579120.958504:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.958538:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.960440:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208704 00000100:00100000:0.0:1789579120.960451:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208704 00000100:00100000:0.0:1789579120.960497:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789579120.960507:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579120.960630:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208704:12345-0@lo:502:mount.lustre.0 Request processed in 125us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.960637:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789579120.960824:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579120.961018:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789579120.961050:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789579120.961063:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789579120.961076:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789579120.961089:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789579120.961102:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789579120.961129:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789579120.961144:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789579120.961157:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789579120.961169:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789579120.961182:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789579120.961194:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789579120.961206:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789579120.961219:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789579120.961233:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789579120.961256:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789579120.961270:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789579120.961294:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789579120.961309:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789579120.961322:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789579120.961334:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789579120.961345:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789579120.961535:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789579120.961553:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789579120.961567:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789579120.961580:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789579120.961592:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789579120.961604:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789579120.961617:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789579120.961630:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789579120.961641:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789579120.961653:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789579120.961666:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789579120.961679:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789579120.961691:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789579120.961703:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789579120.961714:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789579120.961725:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789579120.961749:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789579120.961765:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789579120.961778:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789579120.961788:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789579120.961799:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789579120.961809:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789579120.961820:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789579120.961831:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789579120.961855:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789579120.961870:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789579120.961910:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579120.961961:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.961995:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.963597:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208832 00000100:00100000:0.0:1789579120.963606:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208832 00000100:00100000:0.0:1789579120.963649:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789579120.963658:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579120.963780:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208832:12345-0@lo:502:mount.lustre.0 Request processed in 122us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.963787:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789579120.965832:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579120.966150:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789579120.966299:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789579120.966335:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579120.966714:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.966754:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579120.966871:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277208960 00000100:00100000:0.0:1789579120.966877:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277208960 00000100:00100000:0.0:1789579120.966938:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789579120.966962:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579120.967178:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277208960:12345-0@lo:502:mount.lustre.0 Request processed in 217us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579120.967198:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789579120.971242:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277208960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579120.971329:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789579120.971343:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789579120.981637:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789579120.981664:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9394361599c0) 00000020:00000080:0.0:1789579120.981689:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789579120.981780:0:18644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93940f414000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789579120.981784:0:18644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940f414000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789579120.981787:0:18644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f414000 3 00010000:00080000:0.0:1789579120.981816:0:18644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939436231800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579120.989742:0:18644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789579120.989957:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789579120.990002:0:18644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789579120.990013:0:18644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd90373d592f2207d 00000100:00080000:1.0:1789579120.990023:0:18644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789579120.990034:0:18644:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939436231800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579120.990067:0:18644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439b100 x1876509277209088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579120.990109:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277209088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579120.990167:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.990241:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209088 00000100:00100000:1.0:1789579120.990248:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209088 00000100:00100000:1.0:1789579120.990279:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579120.990286:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277209088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789579120.990308:0:17119:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1789579120.993894:0:17119:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd90373d592f22084 00000004:00100000:1.0:1789579120.993920:0:17119:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789579120.993964:0:17119:0:(import.c:65:import_set_state_nolock()) ffff939403b62800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579120.994056:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876509277209088:12345-0@lo:38:llog_process_th.0 Request processed in 3767us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.994066:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789579120.994114:0:18644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789579120.994410:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.994415:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579120.994418:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.994421:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579120.994444:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.994453:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789579120.994456:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789579120.994459:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789579120.994491:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277209344:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.994527:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579120.994568:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579120.994575:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277209472:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.994604:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789579120.994627:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930439b100 x1876509277209088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579120.994639:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789579120.994647:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209344 00000100:00080000:0.0:1789579120.994648:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:3.0:1789579120.994655:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209344 00000100:00080000:0.0:1789579120.994658:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789579120.994664:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789579120.994667:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436231800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789579120.994673:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3614:1876509277209088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789579120.994693:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579120.994704:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277209344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.994753:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277209344:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.994760:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579120.994784:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209472 00010000:00080000:0.0:1789579120.994819:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304194e00 x1876509277209344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579120.994830:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277209344:0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.994902:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209472 00000100:00100000:3.0:1789579120.994934:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789579120.994941:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277209472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.995126:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277209472:12345-0@lo:400:kworker.0 Request processed in 185us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.995133:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789579120.995210:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277209472:0@lo:400:kworker.0 00000100:00100000:1.0:1789579120.995471:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277209600:0@lo:400:kworker.0 00000100:00100000:1.0:1789579120.995500:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.995523:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579120.995529:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277209216:0@lo:400:kworker.0 00000100:00100000:1.0:1789579120.995550:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.995579:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209216 00000100:00100000:1.0:1789579120.995584:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209216 00000100:00100000:1.0:1789579120.995609:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789579120.995617:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277209216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.995644:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209600 00000100:00100000:3.0:1789579120.995649:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209600 00000100:00100000:1.0:1789579120.995660:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277209216:12345-0@lo:400:kworker.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.995667:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789579120.995678:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579120.995687:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277209600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579120.995731:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277209600:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579120.995738:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000004:1.0:1789579120.995787:0:18644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:0.0:1789579120.995867:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277209216:0@lo:400:kworker.0 00010000:00080000:0.0:1789579120.995879:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939304196300 x1876509277209600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579120.995887:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277209600:0@lo:400:kworker.0 00000020:00000080:1.0:1789579120.996594:0:18644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93943bb3cd40) 00000020:00000080:1.0:1789579120.996618:0:18644:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789579120.996697:0:18644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93940f414000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789579120.996701:0:18644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93940f414000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789579120.996705:0:18644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93940f414000 3 00010000:00080000:1.0:1789579120.996731:0:18644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939304095000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.137@tcp at head 00010000:00010000:1.0:1789579120.998277:0:18644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789579120.998499:0:18644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789579120.998535:0:18644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789579120.998546:0:18644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd90373d592f22092 00000100:00080000:1.0:1789579120.998555:0:18644:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789579120.998564:0:18644:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff939304095000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:1.0:1789579120.998596:0:18644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930439b800 x1876509277209728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579120.998628:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277209728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579120.998681:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579120.998737:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209728 00000100:00100000:1.0:1789579120.998743:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209728 00000100:00100000:1.0:1789579120.998770:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579120.998778:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3614:x1876509277209728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789579120.998802:0:18390:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1789579120.998837:0:18390:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd90373d592f22099 00000004:00100000:1.0:1789579120.998860:0:18390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789579120.998890:0:18390:0:(import.c:65:import_set_state_nolock()) ffff9393023bc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579120.998942:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876509277209728:12345-0@lo:38:llog_process_th.0 Request processed in 163us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579120.998950:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789579120.998984:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93930439b800 x1876509277209728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579120.998993:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579120.999000:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789579120.999006:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789579120.999010:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789579120.999017:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304095000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789579120.999023:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3614:1876509277209728:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789579120.999040:0:18644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789579120.999058:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579120.999062:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579120.999064:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579120.999067:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579120.999071:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579120.999074:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789579120.999077:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789579120.999080:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789579120.999243:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789579121.005960:0:18618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789579121.006002:0:18618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789579121.006027:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.006040:0:18618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304367000/0xd90373d592f22068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2206f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789579121.006096:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789579121.006098:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789579121.006100:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579121.006101:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579121.006103:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579121.006105:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579121.006106:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579121.006107:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579121.006109:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579121.006112:0:18618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789579121.006115:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789579121.006116:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789579121.006118:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789579121.006119:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789579121.006120:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789579121.006121:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789579121.006123:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789579121.006124:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789579121.006125:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789579121.006150:0:18618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789579121.006168:0:18618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277209856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789579121.007503:0:18618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579121.007541:0:18618:0:(client.c:2716:ptlrpc_set_wait()) set ffff939403defc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789579121.007944:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209856 00000100:00100000:2.0:1789579121.007951:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209856 00000100:00100000:2.0:1789579121.007991:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789579121.008000:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277209856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789579121.008026:0:17113:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789579121.008039:0:17113:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789579121.011214:0:17113:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789579121.011232:0:17113:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789579121.011710:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:18618:x1876509277209856:12345-0@lo:253:mount.lustre.0 Request processed in 3708us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579121.011720:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789579121.011855:0:18618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:18618:1876509277209856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789579121.011868:0:18618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789579121.011872:0:18618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789579121.011873:0:18618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789579121.011875:0:18618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789579121.011876:0:18618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789579121.011878:0:18618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789579121.011879:0:18618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789579121.011880:0:18618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789579121.011882:0:18618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789579121.011883:0:18618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789579121.011898:0:18618:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789579121.012635:0:17134:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789579121.012640:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789579121.012658:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012672:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012691:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012709:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012740:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012753:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 20 pid: 17112 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579121.012765:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277209984:0@lo:104: 00000100:00100000:2.0:1789579121.012801:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579121.012856:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.012864:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579121.012873:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277210112:0@lo:104: 00000100:00100000:2.0:1789579121.012895:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579121.012909:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394088e6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789579121.012928:0:17101:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789579121.012939:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277209984 00000100:00100000:2.0:1789579121.012945:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277209984 00000100:00100000:2.0:1789579121.012968:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210112 00000100:00100000:2.0:1789579121.012970:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210112 00000100:00100000:2.0:1789579121.012983:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579121.012990:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277209984:12345-0@lo:104: 00010000:00010000:2.0:1789579121.013001:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.013044:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579121.013049:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277209984:12345-0@lo:104: Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579121.013056:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579121.013069:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579121.013075:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940eb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277210112:12345-0@lo:104: 00010000:00010000:2.0:1789579121.013082:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579121.013109:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789579121.013114:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940eb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277210112:12345-0@lo:104: Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579121.013120:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579121.013159:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277209984:0@lo:104: 00000100:00100000:2.0:1789579121.013167:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277210112:0@lo:104: 00010000:00010000:2.0:1789579121.013181:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013559:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579121.013566:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013580:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366400 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579121.013584:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013592:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579121.013598:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579121.013604:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789579121.013636:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013642:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579121.013661:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013668:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366400/0xd90373d592f21ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21ff8 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013688:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579121.013692:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013696:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579121.013699:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013715:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579121.013720:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579121.013725:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789579121.013737:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013743:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579121.013757:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013765:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae800/0xd90373d592f21fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f21fea expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.013778:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579121.013780:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579121.013782:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579121.013788:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579121.013800:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277210240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579121.013829:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579121.013877:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277210368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579121.013899:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579121.013936:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210240 00000100:00100000:0.0:1789579121.013941:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210240 00010000:00010000:0.0:1789579121.013959:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 21 pid: 17112 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579121.013984:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210368 00000100:00100000:0.0:1789579121.013987:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210368 00010000:00010000:0.0:1789579121.013997:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 22 pid: 17111 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579121.014009:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579121.014015:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+22:3618:x1876509277210240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579121.014025:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579121.014029:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 22 pid: 17112 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014039:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 22 pid: 17112 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014051:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939304366e00/0xd90373d592f21ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21ff1 expref: 22 pid: 17112 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014062:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579121.014088:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+21:3618:x1876509277210240:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579121.014095:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579121.014108:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579121.014113:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+20:3615:x1876509277210368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579121.014121:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579121.014125:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014134:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014150:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436600/0xd90373d592f21fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f21fe3 expref: 20 pid: 17111 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014161:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014169:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789579121.014180:0:17104:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006513262s 00010000:00010000:0.0:1789579121.014185:0:17104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014191:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014197:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014203:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014208:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579121.014212:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014218:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014231:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014247:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579121.014272:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+19:3615:x1876509277210368:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579121.014279:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789579121.014325:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277210240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579121.014340:0:17134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579121.014348:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789579121.015489:0:18618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789579121.015669:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363af600/0xd90373d592f220a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579121.015989:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277210368:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1789579121.020060:0:18618:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789579121.020069:0:18618:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789579121.020101:0:18618:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789579121.020138:0:18618:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789579121.020156:0:18618:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789579121.020232:0:18618:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789579121.021039:0:18618:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579121.021242:0:18618:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579121.571655:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789579122.214093:0:18698:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579122.216953:0:18698:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789579122.346404:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789579122.346415:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f640800 from 9 10000000:01000000:0.0:1789579122.346422:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789579122.346486:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.346500:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.346514:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579122.346550:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789579122.346652:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579122.346717:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579122.346875:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210496 00000100:00100000:2.0:1789579122.346886:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210496 00000100:00100000:2.0:1789579122.346971:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789579122.346983:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+19:17115:x1876509277210496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579122.347001:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579122.347019:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f220a7 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579122.347077:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f220a7 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579122.347091:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220a7 expref: 20 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579122.347101:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae800, rc 0) 00000100:00100000:2.0:1789579122.347153:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+20:17115:x1876509277210496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579122.347161:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789579122.353252:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579122.353293:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.353308:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579122.356955:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789579122.357068:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579122.368858:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210624 00000100:00100000:0.0:1789579122.368881:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210624 00000100:00100000:0.0:1789579122.368969:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789579122.368981:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+20:17115:x1876509277210624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789579122.369016:0:17113:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789579122.369042:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789579122.369046:0:17113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789579122.369213:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+20:17115:x1876509277210624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 234us (12145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579122.369223:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789579122.369501:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579122.369535:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789579122.369622:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579122.369635:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579122.369649:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579122.369672:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789579122.369675:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939304130800 from 9 10000000:01000000:1.0:1789579122.369678:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789579122.370954:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579122.370975:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579122.370988:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579122.371018:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579122.371095:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579122.371146:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789579122.371826:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210752 00000100:00100000:0.0:1789579122.371853:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210752 00000100:00100000:0.0:1789579122.371934:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789579122.371946:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+20:17115:x1876509277210752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579122.371966:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579122.371985:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f220b5 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.372018:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f220b5 expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.372045:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220b5 expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.372056:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436800, rc 0) 00000100:00100000:0.0:1789579122.372129:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277210752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579122.372136:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789579122.372200:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579122.372220:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579122.372230:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579122.372301:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789579122.372340:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579122.380670:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277210880 00000100:00100000:1.0:1789579122.382539:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277210880 00000100:00100000:1.0:1789579122.382635:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789579122.382646:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277210880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789579122.382679:0:17113:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789579122.382724:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789579122.382728:0:17113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789579122.382910:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277210880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 265us (10568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579122.382918:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789579122.391904:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579122.391969:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277210880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789579122.392099:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789579122.392113:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579122.392126:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579122.533036:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579122.533066:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277211008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579122.533156:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579122.533214:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211008 00000100:00100000:0.0:1789579122.533223:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211008 00000100:00100000:0.0:1789579122.533284:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789579122.533294:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277211008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579122.533338:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579122.533420:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277211008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579122.533445:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789579122.533509:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277211008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579122.550663:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579122.550706:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277211136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579122.550817:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579122.550918:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211136 00000100:00100000:2.0:1789579122.550929:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211136 00000100:00100000:2.0:1789579122.550986:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789579122.550997:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277211136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579122.551044:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789579122.551101:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277211136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579122.551109:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789579122.551170:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277211136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789579122.597213:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579123.621525:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579124.643557:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579125.669666:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789579126.117098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579126.117105:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579126.117113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579126.117117:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579126.117133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579126.117136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579126.117139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579126.117141:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789579126.117175:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277211264:0@lo:400:kworker.0 00000100:00100000:2.0:1789579126.117235:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579126.117271:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277211776:0@lo:400:kworker.0 00000100:00100000:1.0:1789579126.117997:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277211648:0@lo:400:kworker.0 00000100:00100000:1.0:1789579126.118030:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579126.118073:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211264 00000100:00100000:1.0:1789579126.118080:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211264 00000100:00100000:1.0:1789579126.118117:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789579126.118125:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:3618:x1876509277211264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579126.118164:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:3618:x1876509277211264:12345-0@lo:400:kworker.0 Request processed in 40us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579126.118170:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789579126.119192:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277211392:0@lo:400:kworker.0 00000100:00100000:0.0:1789579126.119236:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579126.119457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579126.119504:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277211264:0@lo:400:kworker.0 00000100:00100000:2.0:1789579126.119531:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277211520:0@lo:400:kworker.0 00000100:00100000:2.0:1789579126.119555:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579126.119569:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277212032:0@lo:400:kworker.0 00000100:00100000:2.0:1789579126.119588:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579126.119763:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277211904:0@lo:400:kworker.0 00000100:00100000:0.0:1789579126.119789:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579126.119840:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211648 00000100:00100000:0.0:1789579126.119846:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211648 00000100:00100000:0.0:1789579126.119879:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211392 00000100:00100000:0.0:1789579126.119883:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211392 00000100:00100000:0.0:1789579126.119898:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579126.119905:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277211648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579126.119951:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277211648:12345-0@lo:400:kworker.0 Request processed in 47us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579126.119958:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579126.119972:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579126.119977:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277211392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579126.120021:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277211392:12345-0@lo:400:kworker.0 Request processed in 44us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579126.120027:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579126.120081:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277211648:0@lo:400:kworker.0 00000100:00100000:0.0:1789579126.120105:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277211392:0@lo:400:kworker.0 00000100:00100000:3.0:1789579126.120396:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211776 00000100:00100000:3.0:1789579126.120401:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211776 00000100:00100000:3.0:1789579126.120423:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211520 00000100:00100000:3.0:1789579126.120425:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211520 00000100:00100000:3.0:1789579126.120433:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212032 00000100:00100000:3.0:1789579126.120435:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212032 00000100:00100000:3.0:1789579126.120464:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277211904 00000100:00100000:3.0:1789579126.120467:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277211904 00000100:00100000:3.0:1789579126.120481:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579126.120487:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277211776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579126.120524:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277211776:12345-0@lo:400:kworker.0 Request processed in 37us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579126.120529:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579126.120541:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789579126.120546:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277211520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579126.120571:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876509277211520:12345-0@lo:400:kworker.0 Request processed in 26us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579126.120577:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789579126.120586:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579126.120591:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277212032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579126.120611:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277212032:12345-0@lo:400:kworker.0 Request processed in 20us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579126.120616:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579126.120624:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789579126.120629:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277211904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579126.120648:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277211904:12345-0@lo:400:kworker.0 Request processed in 19us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579126.120654:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789579126.120677:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5f800 x1876509277211776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579126.120688:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277211776:0@lo:400:kworker.0 00010000:00080000:3.0:1789579126.120719:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5ca80 x1876509277211520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579126.120729:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876509277211520:0@lo:400:kworker.0 00010000:00080000:3.0:1789579126.120741:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5d180 x1876509277212032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579126.120750:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277212032:0@lo:400:kworker.0 00010000:00080000:0.0:1789579126.120778:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5f480 x1876509277211904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579126.120787:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277211904:0@lo:400:kworker.0 00000100:00080000:1.0:1789579126.120973:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579126.120978:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789579126.695585:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789579127.078154:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789579127.567848:0:18987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789579127.651549:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277212160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579127.651613:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579127.651714:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212160 00000100:00100000:2.0:1789579127.651723:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212160 00000100:00100000:2.0:1789579127.651773:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789579127.651782:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277212160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579127.651824:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789579127.651885:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277212160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579127.651899:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579127.651971:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277212160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579127.654626:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277212288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579127.654684:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579127.654963:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212288 00000100:00100000:3.0:1789579127.654971:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212288 00000100:00100000:3.0:1789579127.655019:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789579127.655028:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277212288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579127.655057:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579127.655974:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277212288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 944us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579127.655983:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579127.658667:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277212288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789579127.716048:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579128.740590:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789579128.885126:0:19040:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579128.885341:0:19040:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789579129.508242:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579129.763623:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789579129.970893:0:19090:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579129.971107:0:19090:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789579130.790565:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789579131.235556:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.235563:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579131.235565:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.235568:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579131.235598:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.235602:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579131.235605:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.235608:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789579131.235646:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277212416:0@lo:400:kworker.0 00000100:00100000:2.0:1789579131.235714:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579131.235756:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277212928:0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.235844:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277212672:0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.235877:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.235898:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277213184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.235900:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277212544:0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.235917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579131.235927:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.235938:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579131.235942:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277213056:0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.235943:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277212800:0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.235962:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.235962:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579131.235990:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579116/real 1789579116] req@ffff939304399180 x1876509277205376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.235990:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212416 00000100:00100000:1.0:1789579131.235996:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212416 00000100:00100000:3.0:1789579131.236007:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939304399180 x1876509277205376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579131.236028:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579116/real 1789579116] req@ffff93930439a680 x1876509277205248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.236032:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789579131.236040:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:3615:x1876509277212416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.236041:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930439a680 x1876509277205248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789579131.236054:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579131.236064:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789579131.236068:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277205376:0@lo:8:kworker.0 00000100:00080000:3.0:1789579131.236073:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789579131.236077:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579131.236078:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:3615:x1876509277212416:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579131.236080:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930439a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277205248:0@lo:8:kworker.0 00000100:00100000:1.0:1789579131.236085:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789579131.236103:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212672 00000100:00100000:3.0:1789579131.236107:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212672 00000100:00100000:1.0:1789579131.236109:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213184 00000100:00100000:1.0:1789579131.236111:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213184 00000100:00100000:3.0:1789579131.236131:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213056 00000100:00100000:3.0:1789579131.236134:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213056 00000100:00100000:1.0:1789579131.236135:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789579131.236141:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277212672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.236147:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579131.236152:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277213184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.236174:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277212672:12345-0@lo:400:kworker.0 Request processed in 33us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579131.236175:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277213184:12345-0@lo:400:kworker.0 Request processed in 24us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579131.236180:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789579131.237070:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579131.237163:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277212416:0@lo:400:kworker.0 00000100:00100000:2.0:1789579131.237191:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212544 00000100:00100000:2.0:1789579131.237195:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212544 00000100:00100000:2.0:1789579131.237232:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212800 00000100:00100000:2.0:1789579131.237235:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212800 00000100:00100000:2.0:1789579131.237247:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789579131.237252:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277212544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579131.237295:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277212544:12345-0@lo:400:kworker.0 Request processed in 42us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579131.237302:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789579131.237314:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789579131.237320:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277212800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579131.237343:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277212800:12345-0@lo:400:kworker.0 Request processed in 24us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579131.237348:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789579131.237838:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789579131.237846:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789579131.237855:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277212928 00000100:00100000:3.0:1789579131.237860:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277212928 00000100:00100000:1.0:1789579131.237861:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277213056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.237895:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579131.237902:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876509277213056:12345-0@lo:400:kworker.0 Request processed in 47us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579131.237906:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277212928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579131.237919:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789579131.237944:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579131.237949:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579131.237973:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277212800:0@lo:400:kworker.0 00000100:00080000:2.0:1789579131.238138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.238142:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579131.238145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.238147:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579131.238150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.238152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789579131.238155:0:36:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579131.238160:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1789579131.238164:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789579131.238171:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939302b3b800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579131.238194:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489d180 x1876509277213312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579131.238211:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579131.238214:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789579131.238215:0:36:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579131.238218:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1789579131.238226:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789579131.238231:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579131.238250:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93930489d500 x1876509277213440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789579131.238838:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277212928:12345-0@lo:400:kworker.0 Request processed in 934us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579131.238852:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789579131.238857:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5d180 x1876509277212672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.238867:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277212672:0@lo:400:kworker.0 00010000:00080000:1.0:1789579131.238879:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930489d880 x1876509277213184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.238885:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277213184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.238897:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277212544:0@lo:400:kworker.0 00010000:00080000:3.0:1789579131.238913:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5c380 x1876509277213056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579131.238923:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876509277213056:0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.238947:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277213312:0@lo:8:kworker.0 00000100:00100000:3.0:1789579131.238977:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579131.239009:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277213440:0@lo:8:kworker.0 00000100:00100000:3.0:1789579131.239028:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.239063:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213312 00000100:00100000:1.0:1789579131.239069:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213312 00000100:00100000:1.0:1789579131.239098:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213440 00000100:00100000:1.0:1789579131.239102:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213440 00010000:00080000:0.0:1789579131.239269:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5f800 x1876509277212928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579131.239279:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277212928:0@lo:400:kworker.0 00000100:00100000:3.0:1789579131.240390:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579131.240398:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277213312:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789579131.240424:0:18624:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789579131.240450:0:18624:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f220c3 00002000:00100000:3.0:1789579131.240462:0:18624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93930377f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789579131.240466:0:18624:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789579131.240470:0:18624:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789579131.240626:0:18624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789579131.240648:0:18624:0:(import.c:65:import_set_state_nolock()) ffff93930377c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579131.240697:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277213312:12345-0@lo:8:kworker.0 Request processed in 299us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579131.240704:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789579131.240719:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579131.240723:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277213440:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789579131.240745:0:18624:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789579131.245438:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930489d180 x1876509277213312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579131.245454:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579131.245464:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789579131.245473:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789579131.245478:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789579131.245481:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939302b3b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789579131.245502:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789579131.245508:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277213312:0@lo:8:kworker.0 00000004:00080000:2.0:1789579131.245537:0:17858:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789579131.245615:0:17858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 486378263478ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789579131.245621:0:17858:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789579131.246846:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277213568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579131.246899:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789579131.246949:0:17859:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789579131.247032:0:17859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213696:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789579131.247063:0:17859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579131.247080:0:17859:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941031a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579131.247107:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213568 00000100:00100000:0.0:1789579131.247113:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213568 00000100:00100000:0.0:1789579131.247163:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579131.247172:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277213568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789579131.247196:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579131.247502:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876509277213568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579131.247511:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579131.247541:0:18623:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789579131.247547:0:18623:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1789579131.247561:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579131.247655:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213696 00000100:00100000:0.0:1789579131.247659:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213696 00000100:00100000:0.0:1789579131.247744:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789579131.247751:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17859:x1876509277213696:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:2.0:1789579131.251067:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a31f80 x1876509277213568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579131.251091:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277213568:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789579131.253700:0:17849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1789579131.254452:0:19143:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789579131.254458:0:19143:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789579131.254559:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17859:x1876509277213696:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6805us (7492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579131.254581:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789579131.254752:0:17859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a31180 x1876509277213696/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789579147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.254775:0:17859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213696:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789579131.254790:0:17859:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789579131.254832:0:17859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304337b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213824:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789579131.254903:0:17859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.254936:0:17859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579131.254954:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213824 00000100:00100000:2.0:1789579131.254971:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213824 00000100:00100000:2.0:1789579131.255014:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789579131.255024:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17859:x1876509277213824:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789579131.255048:0:18623:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789579131.255089:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17859:x1876509277213824:12345-0@lo:5:osp-pre-0-1.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579131.255095:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789579131.255104:0:17859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304337b80 x1876509277213824/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579131.255114:0:17859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304337b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213824:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789579131.255133:0:17859:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789579131.255156:0:17859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304337b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213952:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789579131.255178:0:17859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579131.255199:0:17859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394100dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579131.255409:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277213952 00000100:00100000:2.0:1789579131.255414:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277213952 00000100:00100000:2.0:1789579131.255439:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789579131.255445:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17859:x1876509277213952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789579131.255468:0:19143:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789579131.270341:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277213440:12345-0@lo:8:kworker.0 Request processed in 29609us (31305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579131.270384:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789579131.273706:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579131.273716:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789579131.273721:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277213440:0@lo:8:kworker.0 00000001:00080000:3.0:1789579131.277585:0:18619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789579131.277601:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789579131.284136:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17859:x1876509277213952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28683us (28949us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789579131.284149:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789579131.284346:0:17859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304337b80 x1876509277213952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579131.284376:0:17859:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789579131.284383:0:17859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304337b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17859:1876509277213952:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789579131.284407:0:17859:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789579131.284465:0:17859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17859:1876509277214080:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789579131.284705:0:17859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579131.284752:0:17859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579131.286531:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214080 00000100:00100000:0.0:1789579131.286542:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214080 00000100:00100000:0.0:1789579131.286687:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789579131.286696:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17859:x1876509277214080:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789579131.286784:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17859:x1876509277214080:12345-0@lo:900:osp-pre-0-1.0 Request processed in 89us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579131.286791:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789579131.286851:0:17859:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93930489d500 x1876509277214080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579131.286865:0:17859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17859:1876509277214080:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789579131.811476:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579132.771579:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277214336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579132.771640:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579132.771682:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789579132.771687:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277214208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579132.771708:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579132.771737:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214336 00000100:00100000:3.0:1789579132.771744:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214336 00000100:00100000:3.0:1789579132.771792:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214208 00000100:00100000:3.0:1789579132.771796:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214208 00000100:00100000:3.0:1789579132.771809:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579132.771817:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277214336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579132.771860:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579132.771911:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277214336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579132.771918:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789579132.771933:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579132.771939:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277214208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579132.771967:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789579132.771994:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277214208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579132.772006:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579132.772044:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277214208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579132.772053:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277214336:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789579132.837017:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579133.859682:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579134.887921:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579135.909621:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789579136.365654:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579136.365659:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579136.365662:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579136.365675:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579136.365707:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579136.365710:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789579136.365714:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579136.365721:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1789579136.365737:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789579136.365748:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579136.365769:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a30700 x1876509277215104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789579136.365834:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277214464:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.365894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.365935:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277214976:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.365957:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.365979:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789579136.365985:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277214592:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366004:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366018:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277215232:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366034:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366058:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277214720:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366076:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366089:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277215360:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366104:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366118:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789579136.366122:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277214848:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366138:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366150:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277215488:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366169:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366191:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214464 00000100:00100000:0.0:1789579136.366197:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214464 00000100:00100000:0.0:1789579136.366232:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789579136.366240:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:3617:x1876509277214464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366292:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+21:3617:x1876509277214464:12345-0@lo:400:kworker.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366316:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789579136.366345:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214976 00000100:00100000:0.0:1789579136.366376:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214976 00000100:00100000:0.0:1789579136.366412:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579136.366418:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277214976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366449:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277214976:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366465:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789579136.366483:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214592 00000100:00100000:0.0:1789579136.366485:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214592 00000100:00100000:0.0:1789579136.366504:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214848 00000100:00100000:0.0:1789579136.366506:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214848 00000100:00100000:0.0:1789579136.366517:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789579136.366523:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277214592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366550:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277214592:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366556:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789579136.366565:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579136.366570:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277214848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366593:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277214848:12345-0@lo:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366598:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789579136.366612:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215232 00000100:00100000:0.0:1789579136.366615:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215232 00000100:00100000:0.0:1789579136.366628:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277214720 00000100:00100000:0.0:1789579136.366630:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277214720 00000100:00100000:0.0:1789579136.366638:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215360 00000100:00100000:0.0:1789579136.366645:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215360 00000100:00100000:0.0:1789579136.366658:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215488 00000100:00100000:0.0:1789579136.366660:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215488 00000100:00100000:0.0:1789579136.366672:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789579136.366677:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277215232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366701:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277215232:12345-0@lo:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366707:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789579136.366716:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789579136.366720:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277214720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366753:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277214720:12345-0@lo:400:kworker.0 Request processed in 32us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366758:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789579136.366768:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789579136.366773:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277215360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366792:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277215360:12345-0@lo:400:kworker.0 Request processed in 19us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366797:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789579136.366805:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789579136.366809:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.366826:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277215488:12345-0@lo:400:kworker.0 Request processed in 18us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579136.366832:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789579136.366858:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789579136.366861:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789579136.366864:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789579136.366876:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277215104:0@lo:8:kworker.0 00000100:00100000:0.0:1789579136.366915:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579136.366954:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277214848:0@lo:400:kworker.0 00010000:00080000:0.0:1789579136.366964:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a30e00 x1876509277215488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579136.366973:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277215488:0@lo:400:kworker.0 00010000:00080000:0.0:1789579136.366981:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a33800 x1876509277214720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579136.366989:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277214720:0@lo:400:kworker.0 00010000:00080000:0.0:1789579136.366996:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a31f80 x1876509277215360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579136.367004:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277215360:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.367026:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277214592:0@lo:400:kworker.0 00010000:00080000:0.0:1789579136.367035:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a31180 x1876509277215232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579136.367043:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277215232:0@lo:400:kworker.0 00000100:00100000:0.0:1789579136.367049:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277214464:0@lo:400:kworker.0 00010000:00080000:0.0:1789579136.367057:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a30380 x1876509277214976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579136.367064:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277214976:0@lo:400:kworker.0 00000100:00100000:2.0:1789579136.367991:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215104 00000100:00100000:2.0:1789579136.367998:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215104 00000100:00100000:2.0:1789579136.368024:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579136.368041:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277215104:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789579136.368059:0:18624:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789579136.379865:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277215616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789579136.379924:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579136.380033:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215616 00000100:00100000:3.0:1789579136.380040:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215616 00000100:00100000:3.0:1789579136.380082:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789579136.380091:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277215616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579136.380117:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579136.380158:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277215616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579136.380164:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789579136.380198:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939304197100 x1876509277215616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579136.380214:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277215616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579136.394186:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3614:x1876509277215104:12345-0@lo:8:kworker.0 Request processed in 26147us (27261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789579136.394201:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789579136.394315:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789579136.394321:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789579136.394325:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277215104:0@lo:8:kworker.0 00010000:00010000:1.0:1789579136.937676:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579137.317240:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789579137.891533:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277215744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579137.891601:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579137.891769:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789579137.891778:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277215872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579137.891805:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579137.893987:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215744 00000100:00100000:0.0:1789579137.893999:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215744 00000100:00100000:0.0:1789579137.894048:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277215872 00000100:00100000:0.0:1789579137.894052:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277215872 00000100:00100000:0.0:1789579137.894068:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789579137.894076:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277215744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579137.894107:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579137.894172:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277215744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579137.894179:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789579137.894195:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789579137.894201:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277215872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579137.894216:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789579137.894260:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277215872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579137.894266:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789579137.894513:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277215872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579137.894637:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277215744:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579137.956915:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579138.979912:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789579138.984037:0:19436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789579138.984040:0:19436:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789579138.984042:0:19436:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789579138.984177:0:19436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93930377d800 00000020:01000004:3.0:1789579138.984191:0:19436:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789579138.984208:0:19436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789579138.984222:0:19436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff939405a999c0) 00000020:00000080:3.0:1789579138.984239:0:19436:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789579139.077079:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789579139.092171:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789579139.092642:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789579139.092888:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789579139.093134:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789579139.093381:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789579139.093625:0:19436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1789579139.094483:0:19436:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789579139.094688:0:19436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789579139.094702:0:19436:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789579139.094730:0:19436:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f220d1 00000020:01000004:0.0:1789579139.094737:0:19436:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789579139.094768:0:19436:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789579139.094771:0:19436:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789579139.094778:0:19436:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789579139.094804:0:19436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789579139.094808:0:19436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789579139.116431:0:19436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789579139.116479:0:19436:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.137@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789579139.116484:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789579139.116486:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.116488:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.116493:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.116494:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.116496:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.116497:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.116499:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.116500:0:19436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789579139.116504:0:19436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789579139.116506:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789579139.116508:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.116509:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.116519:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.116520:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.116522:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.116523:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.116524:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.116525:0:19436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789579139.116553:0:19436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789579139.116577:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789579139.116659:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.116720:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.116801:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216000 00000100:00100000:1.0:1789579139.116813:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216000 00000100:00100000:1.0:1789579139.116868:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789579139.116877:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:19436:x1876509277216000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789579139.116906:0:17113:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789579139.116909:0:17113:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789579139.116913:0:17113:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789579139.117568:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:19436:x1876509277216000:12345-0@lo:253:mount.lustre.0 Request processed in 692us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.117581:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789579139.117702:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789579139.117722:0:19436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789579139.117725:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789579139.117726:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.117727:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.117729:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.117729:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.117730:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.117731:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.117732:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.117738:0:19436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789579139.117767:0:19436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93930377d800 from lustre-OST0001 10000000:01000000:2.0:1789579139.117794:0:19436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789579139.117797:0:19436:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789579139.117808:0:19436:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93943f544d40 local copy 00010000:00010000:2.0:1789579139.117821:0:19436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579139.117898:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579139.117932:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.117951:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579139.118059:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216128 00000100:00100000:0.0:1789579139.118064:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216128 00000100:00100000:0.0:1789579139.118101:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789579139.118108:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:19436:x1876509277216128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579139.118175:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:19436:x1876509277216128:12345-0@lo:501:mount.lustre.0 Request processed in 68us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789579139.118182:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789579139.118651:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216128:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789579139.118671:0:19436:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789579139.118719:0:19436:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789579139.118726:0:19436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.118740:0:19436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437600/0xd90373d592f21deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f21df2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579139.118783:0:19436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93930377d800 10000000:01000000:2.0:1789579139.118788:0:19436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789579139.118794:0:19436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789579139.118796:0:19436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789579139.118804:0:19436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789579139.118811:0:19436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789579139.118839:0:19436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.118848:0:19436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.118862:0:19436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579139.118877:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579139.118905:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.118933:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.119048:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216256 00000100:00100000:1.0:1789579139.119054:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216256 00000100:00100000:1.0:1789579139.119078:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789579139.119084:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:19436:x1876509277216256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789579139.119093:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579139.119106:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939304367200/0xd90373d592f220df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f220d8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.119129:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939304367200/0xd90373d592f220df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f220d8 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.119147:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939304367200/0xd90373d592f220df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220d8 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.119155:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304367200, rc 0) 00000100:00100000:1.0:1789579139.119196:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216256:12345-0@lo:101:mount.lustre.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.119203:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789579139.120175:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579139.120192:0:19436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.120215:0:19436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579139.123093:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789579139.124928:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579139.131792:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789579139.131847:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789579139.131861:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789579139.131874:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789579139.131887:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789579139.131901:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789579139.131943:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789579139.131949:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789579139.132063:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579139.132128:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.132178:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff939302a95240 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.132727:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216384 00000100:00100000:1.0:1789579139.132736:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216384 00000100:00100000:1.0:1789579139.132797:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789579139.132806:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579139.132958:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216384:12345-0@lo:501:mount.lustre.0 Request processed in 152us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.132966:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789579139.133051:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579139.133094:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579139.133140:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.133169:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408f64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.133380:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216512 00000100:00100000:1.0:1789579139.133384:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216512 00000100:00100000:1.0:1789579139.133410:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789579139.133416:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579139.134395:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216512:12345-0@lo:503:mount.lustre.0 Request processed in 976us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.134404:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789579139.134499:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579139.134924:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579139.135008:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579139.135047:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.135083:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.135251:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216640 00000100:00100000:1.0:1789579139.135258:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216640 00000100:00100000:1.0:1789579139.135294:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789579139.135302:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579139.135744:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216640:12345-0@lo:502:mount.lustre.0 Request processed in 441us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.135766:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789579139.135894:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579139.136084:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789579139.136110:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789579139.136124:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789579139.136136:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789579139.136148:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789579139.136159:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789579139.136171:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789579139.136183:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789579139.136196:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789579139.136220:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579139.136268:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579139.136296:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394183ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.136437:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216768 00000100:00100000:1.0:1789579139.136443:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216768 00000100:00100000:1.0:1789579139.136462:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789579139.136469:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579139.136541:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216768:12345-0@lo:502:mount.lustre.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.136548:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789579139.136767:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579139.136805:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789579139.136815:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789579139.137651:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789579139.137659:0:19440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789579139.137666:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.137668:0:19440:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789579139.137674:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789579139.137689:0:19440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff939405a9cd40) 00000020:00000080:3.0:1789579139.137724:0:19440:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789579139.137730:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789579139.137865:0:19440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93930377d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789579139.137874:0:19440:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789579139.137881:0:19440:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd90373d592f220ed 00010000:00010000:3.0:1789579139.145623:0:19440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789579139.148438:0:19440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789579139.153296:0:19440:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789579139.164258:0:19440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789579139.164270:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579139.164277:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.164279:0:19440:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789579139.164282:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579139.164285:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.164287:0:19440:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789579139.164290:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789579139.164292:0:19440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789579139.164294:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579139.164296:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.164298:0:19440:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789579139.164300:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579139.164302:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.164304:0:19440:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789579139.164309:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789579139.164336:0:19440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579139.164339:0:19440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.164341:0:19440:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789579139.164343:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789579139.164563:0:19436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789579139.164601:0:19436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789579139.164629:0:19436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.164641:0:19436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363aea00/0xd90373d592f220d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220df expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579139.164649:0:19436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93930377d800 from 1 10000000:01000000:0.0:1789579139.164652:0:19436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789579139.164684:0:19436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.164692:0:19436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.164702:0:19436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579139.164735:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789579139.164808:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.164850:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579139.164952:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277216896 00000100:00100000:3.0:1789579139.164960:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277216896 00000100:00100000:3.0:1789579139.165007:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789579139.165016:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:19436:x1876509277216896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789579139.165027:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579139.165039:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f220f4 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.165061:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.165072:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.165080:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7600, rc 0) 00000100:00100000:3.0:1789579139.165116:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277216896:12345-0@lo:101:mount.lustre.0 Request processed in 100us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579139.165122:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789579139.169163:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277216896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789579139.169189:0:19436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.169202:0:19436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579139.172254:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789579139.172552:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579139.172746:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789579139.173025:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789579139.173045:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789579139.173050:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789579139.173118:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579139.173180:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.173223:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.173304:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217024 00000100:00100000:1.0:1789579139.173311:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217024 00000100:00100000:1.0:1789579139.173385:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789579139.173395:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789579139.173494:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217024:12345-0@lo:501:mount.lustre.0 Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.173501:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789579139.173822:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789579139.173852:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789579139.173891:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.173958:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394012ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.181150:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217152 00000100:00100000:1.0:1789579139.181162:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217152 00000100:00100000:1.0:1789579139.181218:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789579139.181229:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789579139.181491:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217152:12345-0@lo:503:mount.lustre.0 Request processed in 263us (7598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.181499:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789579139.181600:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789579139.182022:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789579139.182097:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789579139.182140:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.182171:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1789579139.184880:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217280 00000100:00100000:3.0:1789579139.184894:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217280 00000100:00100000:3.0:1789579139.184961:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789579139.184972:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579139.185138:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217280:12345-0@lo:502:mount.lustre.0 Request processed in 167us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579139.185146:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789579139.185398:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579139.185657:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789579139.185690:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789579139.185719:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789579139.185737:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789579139.185761:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789579139.185779:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789579139.185792:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789579139.185805:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789579139.185817:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789579139.185830:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789579139.185843:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789579139.185876:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789579139.185929:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.185963:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441963900 going to sleep for 11 seconds 00000100:00100000:2.0:1789579139.186127:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217408 00000100:00100000:2.0:1789579139.186133:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217408 00000100:00100000:2.0:1789579139.186169:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789579139.186176:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.186265:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217408:12345-0@lo:502:mount.lustre.0 Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.186272:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789579139.186980:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304334a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789579139.187056:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789579139.187067:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789579139.188645:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579139.188656:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.188659:0:19444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789579139.188666:0:19444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93930377d800 00000020:00000080:3.0:1789579139.188668:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579139.188675:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579139.188678:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.188679:0:19444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789579139.188681:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579139.188684:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.188685:0:19444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789579139.188688:0:19444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93930377d800 00000020:00000080:3.0:1789579139.188690:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579139.188880:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789579139.188885:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.188886:0:19444:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789579139.188889:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789579139.188892:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789579139.188893:0:19444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789579139.188897:0:19444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93930377d800 00000020:00000080:3.0:1789579139.188899:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789579139.197015:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579139.198952:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.198958:0:19444:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789579139.198967:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789579139.198973:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.198974:0:19444:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789579139.198979:0:19444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93930377d800 00000020:00000080:1.0:1789579139.198982:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789579139.199068:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789579139.199072:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789579139.199073:0:19444:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789579139.199076:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789579139.199768:0:19436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789579139.199801:0:19436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579139.199820:0:19436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.199841:0:19436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789579139.199892:0:19436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789579139.199895:0:19436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93930377d800 10000000:01000000:2.0:1789579139.199898:0:19436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93930377d800 10000000:01000000:2.0:1789579139.199902:0:19436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789579139.199907:0:19436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93930377d800 from 1 10000000:01000000:2.0:1789579139.199910:0:19436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789579139.199942:0:19436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.199949:0:19436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.199960:0:19436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579139.199983:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789579139.200045:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.200082:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217536 00000100:00100000:2.0:1789579139.200088:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217536 00000100:00100000:2.0:1789579139.200131:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789579139.200139:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:19436:x1876509277217536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579139.200152:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579139.200164:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394363aec00/0xd90373d592f22109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22102 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.200196:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394363aec00/0xd90373d592f22109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22102 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.200207:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394363aec00/0xd90373d592f22109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22102 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.200216:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363aec00, rc 0) 00000100:00100000:2.0:1789579139.200247:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217536:12345-0@lo:101:mount.lustre.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.200254:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789579139.200292:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579139.200312:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789579139.200326:0:19436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.200335:0:19436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579139.202141:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789579139.202426:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789579139.202586:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789579139.202609:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789579139.202622:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789579139.202635:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789579139.202648:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789579139.202661:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789579139.202687:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789579139.202702:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789579139.202738:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789579139.202755:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789579139.202769:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789579139.202795:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789579139.202809:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789579139.202821:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789579139.202831:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789579139.202842:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789579139.202853:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789579139.202866:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789579139.202879:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789579139.202891:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789579139.202905:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789579139.202919:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789579139.202930:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789579139.202941:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789579139.202954:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789579139.202966:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789579139.202978:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789579139.203002:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789579139.203018:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789579139.203029:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789579139.203041:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789579139.203053:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789579139.203065:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789579139.203076:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789579139.203087:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789579139.203099:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789579139.203109:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789579139.203121:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789579139.203132:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789579139.203146:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789579139.203157:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789579139.203180:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789579139.203195:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789579139.203223:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789579139.203240:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789579139.203255:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789579139.203276:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789579139.203282:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789579139.203380:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579139.203435:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.203474:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579139.203793:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217664 00000100:00100000:3.0:1789579139.203800:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217664 00000100:00100000:3.0:1789579139.203839:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789579139.203848:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789579139.203960:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217664:12345-0@lo:501:mount.lustre.0 Request processed in 113us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579139.203968:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789579139.208413:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789579139.208468:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789579139.208529:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.208564:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789579139.208651:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217792 00000100:00100000:3.0:1789579139.208658:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217792 00000100:00100000:3.0:1789579139.208699:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789579139.208727:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789579139.208894:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217792:12345-0@lo:503:mount.lustre.0 Request processed in 168us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579139.208902:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789579139.212399:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217792:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789579139.212886:0:19436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789579139.212965:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.213032:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.213068:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277217920 00000100:00100000:2.0:1789579139.213074:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277217920 00000100:00100000:2.0:1789579139.213112:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789579139.213119:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.213224:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277217920:12345-0@lo:502:mount.lustre.0 Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.213232:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789579139.213281:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579139.213301:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277217920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579139.213471:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789579139.213497:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789579139.213510:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789579139.213522:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789579139.213535:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789579139.213549:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789579139.213561:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789579139.213573:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789579139.213586:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789579139.213600:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789579139.213625:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789579139.213640:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789579139.213653:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789579139.213664:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789579139.213677:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789579139.213689:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789579139.225084:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789579139.225161:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789579139.225179:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789579139.225192:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789579139.225204:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789579139.225216:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789579139.225227:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789579139.225257:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789579139.225273:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789579139.225288:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789579139.225321:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789579139.225336:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789579139.225365:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789579139.225382:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789579139.225395:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789579139.225418:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789579139.225430:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789579139.225443:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789579139.225467:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789579139.225482:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789579139.225494:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789579139.225505:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789579139.225517:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789579139.225529:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789579139.225542:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789579139.225555:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789579139.225581:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789579139.225596:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789579139.225609:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789579139.225620:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789579139.225633:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789579139.225647:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789579139.225701:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277218048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.226624:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.226671:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218048 00000100:00100000:2.0:1789579139.226678:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218048 00000100:00100000:2.0:1789579139.226730:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789579139.226739:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277218048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.227439:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277218048:12345-0@lo:502:mount.lustre.0 Request processed in 700us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.227448:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789579139.227517:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579139.227539:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277218048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789579139.227738:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789579139.229934:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789579139.229986:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277218176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789579139.230057:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.230092:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218176 00000100:00100000:2.0:1789579139.230099:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218176 00000100:00100000:2.0:1789579139.230138:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789579139.230145:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277218176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789579139.230801:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9393039fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789579139.231862:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277218176:12345-0@lo:502:mount.lustre.0 Request processed in 1713us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.231873:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789579139.238090:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277218176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789579139.238211:0:19436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789579139.238224:0:19436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789579139.241546:0:19449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789579139.241563:0:19449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93943bbacd40) 00000020:00000080:2.0:1789579139.241588:0:19449:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789579139.241682:0:19449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93930377d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579139.241685:0:19449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93930377d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579139.241688:0:19449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93930377d800 3 00010000:00080000:2.0:1789579139.241728:0:19449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939304086800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.137@tcp at head 00010000:00010000:2.0:1789579139.247392:0:19449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789579139.253639:0:19449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789579139.253686:0:19449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789579139.253700:0:19449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd90373d592f22117 00000100:00080000:2.0:1789579139.253799:0:19449:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789579139.253811:0:19449:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939304086800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579139.253846:0:19449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5d180 x1876509277218304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789579139.253883:0:19449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789579139.253900:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277218304:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789579139.253922:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579139.253931:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579139.253934:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789579139.253936:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789579139.253972:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789579139.253972:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789579139.253975:0:14907:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789579139.253977:0:14907:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789579139.253981:0:14907:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 491 00000100:00080000:2.0:1789579139.253984:0:14907:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1789579139.257740:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218304 00000100:00100000:0.0:1789579139.257765:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218304 00000100:00100000:0.0:1789579139.257806:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789579139.257814:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876509277218304:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789579139.257841:0:17119:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1789579139.257874:0:17119:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd90373d592f2211e 00000004:00100000:0.0:1789579139.257888:0:17119:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789579139.257919:0:17119:0:(import.c:65:import_set_state_nolock()) ffff939436de9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579139.258015:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876509277218304:12345-0@lo:38:llog_process_th.0 Request processed in 200us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579139.258022:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789579139.258530:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5d180 x1876509277218304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579139.258541:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789579139.258548:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789579139.258555:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789579139.258559:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789579139.258561:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304086800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789579139.258567:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3614:1876509277218304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579139.261397:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277218688:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261467:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.261507:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579139.261514:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277218560:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261536:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.261566:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277218816:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261589:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.261608:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579139.261614:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277218432:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261634:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.261670:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218688 00000100:00100000:1.0:1789579139.261677:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218688 00000100:00100000:1.0:1789579139.261727:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218432 00000100:00100000:1.0:1789579139.261731:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218432 00000100:00100000:1.0:1789579139.261747:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579139.261823:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277218688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261884:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277218688:12345-0@lo:400:kworker.0 Request processed in 62us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.261891:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579139.261910:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579139.261916:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277218432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.261947:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277218432:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.261953:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579139.261971:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218560 00000100:00100000:1.0:1789579139.261975:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218560 00000100:00100000:1.0:1789579139.262000:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789579139.262007:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277218560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.262036:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277218560:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.262042:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789579139.262060:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218816 00000100:00100000:1.0:1789579139.262063:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218816 00000100:00100000:1.0:1789579139.262095:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789579139.262101:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277218816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.264376:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277218816:12345-0@lo:400:kworker.0 Request processed in 2267us (2777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.264387:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789579139.264432:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579139.264480:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277218432:0@lo:400:kworker.0 00010000:00080000:1.0:1789579139.264494:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5c380 x1876509277218816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789579155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579139.264514:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277218816:0@lo:400:kworker.0 00010000:00080000:1.0:1789579139.264551:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5f480 x1876509277218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579139.264560:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277218560:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.264569:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277218688:0@lo:400:kworker.0 00000100:00080000:2.0:1789579139.267660:0:14907:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:2.0:1789579139.267701:0:14907:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a5ce00 x1876509277218944/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789579139.267747:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277218944:0@lo:8:kworker.0 00000100:00100000:2.0:1789579139.267807:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.267864:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277218944 00000100:00100000:2.0:1789579139.267872:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277218944 00000100:00100000:2.0:1789579139.267902:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579139.267909:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277218944:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789579139.267963:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277218944:12345-0@lo:8:kworker.0 Request processed in 53us (156us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789579139.267970:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789579139.268016:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789579139.268023:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789579139.268027:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789579139.268030:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277218944:0@lo:8:kworker.0 00000100:00100000:0.0:1789579139.268099:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579139.268110:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277219072:0@lo:400:kworker.0 00000100:00100000:0.0:1789579139.268154:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.268561:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219072 00000100:00100000:2.0:1789579139.268584:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219072 00000100:00100000:2.0:1789579139.268623:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789579139.268630:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277219072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579139.268682:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277219072:12345-0@lo:400:kworker.0 Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.268689:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789579139.268747:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5ce00 x1876509277219072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579139.268757:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277219072:0@lo:400:kworker.0 00000020:01000004:2.0:1789579139.269470:0:19449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789579139.269497:0:19449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9393037c3380) 00000020:00000080:2.0:1789579139.269518:0:19449:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789579139.269598:0:19449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93930377d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579139.269602:0:19449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93930377d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789579139.269604:0:19449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93930377d800 3 00010000:00080000:2.0:1789579139.269629:0:19449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939304082800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.137@tcp at head 00000100:00100000:1.0:1789579139.270481:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277219200:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.270524:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579139.270998:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579139.271006:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277219328:0@lo:400:kworker.0 00000100:00100000:1.0:1789579139.271031:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.271537:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219200 00000100:00100000:0.0:1789579139.271543:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219200 00000100:00100000:0.0:1789579139.271621:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219328 00000100:00100000:0.0:1789579139.271625:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219328 00000100:00100000:2.0:1789579139.271654:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789579139.271663:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277219200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579139.271725:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277219200:12345-0@lo:400:kworker.0 Request processed in 63us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.271732:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789579139.271826:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579139.271830:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789579139.271857:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5c380 x1876509277219200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579139.271870:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277219200:0@lo:400:kworker.0 00000100:00100000:0.0:1789579139.272064:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789579139.272641:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277219328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579139.272685:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277219328:12345-0@lo:400:kworker.0 Request processed in 614us (1653us total) trans 0 rc 0/0 00010000:00080000:2.0:1789579139.272746:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939303a5ca80 x1876509277219328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579139.272765:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277219328:0@lo:400:kworker.0 00000100:00100000:0.0:1789579139.272996:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789579139.276605:0:19449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789579139.277039:0:19449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789579139.277085:0:19449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789579139.277109:0:19449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd90373d592f2212c 00000100:00080000:0.0:1789579139.277123:0:19449:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789579139.277134:0:19449:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff939304082800 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579139.277167:0:19449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043ab100 x1876509277219456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579139.277229:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277219456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789579139.277302:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579139.277397:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219456 00000100:00100000:3.0:1789579139.277404:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219456 00000100:00100000:3.0:1789579139.277438:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579139.277444:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876509277219456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789579139.277468:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000100:00080000:0.0:1789579139.277491:0:19449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000020:00000080:3.0:1789579139.277496:0:17120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd90373d592f22133 00000004:00100000:3.0:1789579139.277509:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789579139.277544:0:17120:0:(import.c:65:import_set_state_nolock()) ffff9393034fc000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789579139.277579:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579139.277584:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789579139.277587:0:14907:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579139.277590:0:14907:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789579139.279077:0:19449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789579139.280215:0:19436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789579139.280314:0:19436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789579139.280333:0:19436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.280345:0:19436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394363aee00/0xd90373d592f22102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22109 expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789579139.280444:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789579139.280446:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.280448:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.280449:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.280450:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.280452:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.280453:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.280455:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.280456:0:19436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789579139.280460:0:19436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789579139.280463:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789579139.280464:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.280465:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.280466:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.280467:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.280468:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.280470:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.280471:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.280472:0:19436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789579139.280494:0:19436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789579139.280510:0:19436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277219584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789579139.280562:0:19436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579139.280592:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219584 00000100:00100000:2.0:1789579139.280599:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219584 00000100:00100000:2.0:1789579139.280634:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789579139.280642:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277219584:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789579139.280667:0:17113:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789579139.280680:0:17113:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789579139.281028:0:19436:0:(client.c:2716:ptlrpc_set_wait()) set ffff939409058540 going to sleep for 11 seconds 00000100:00100000:3.0:1789579139.282287:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876509277219456:12345-0@lo:38:llog_process_th.0 Request processed in 4838us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579139.282297:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789579139.285875:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9393043ab100 x1876509277219456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789579149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579139.286002:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579139.286013:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789579139.286022:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789579139.286027:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789579139.286037:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939304082800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789579139.286045:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3614:1876509277219456:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789579139.303043:0:17113:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789579139.303223:0:17113:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789579139.303531:0:17134:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789579139.303536:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789579139.303560:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303578:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220a7 expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303586:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220b5 expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303595:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303633:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303647:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 24 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579139.303676:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277219712:0@lo:104: 00000100:00100000:0.0:1789579139.303747:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579139.303811:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.303820:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 24 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579139.303827:0:17134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277219840:0@lo:104: 00000100:00100000:0.0:1789579139.303847:0:17134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579139.303861:0:17134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579139.304524:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:19436:x1876509277219584:12345-0@lo:253:mount.lustre.0 Request processed in 23880us (23958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.304534:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789579139.304979:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219712 00000100:00100000:2.0:1789579139.304987:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219712 00000100:00100000:2.0:1789579139.305015:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219840 00000100:00100000:2.0:1789579139.305018:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219840 00000100:00100000:2.0:1789579139.305044:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579139.305051:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277219712:12345-0@lo:104: 00010000:00010000:2.0:1789579139.305064:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.305124:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579139.305137:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:17134:x1876509277219712:12345-0@lo:104: Request processed in 87us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.305144:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789579139.305156:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579139.305162:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277219840:12345-0@lo:104: 00010000:00010000:2.0:1789579139.305169:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579139.305197:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789579139.305202:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:17134:x1876509277219840:12345-0@lo:104: Request processed in 41us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579139.305207:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789579139.305256:0:19436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:044b3bf9-43fa-4501-b924-7b81ca047525:19436:1876509277219584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789579139.305268:0:19436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789579139.305271:0:19436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789579139.305273:0:19436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789579139.305274:0:19436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789579139.305276:0:19436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789579139.305277:0:19436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789579139.305278:0:19436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789579139.305280:0:19436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789579139.305281:0:19436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789579139.305283:0:19436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789579139.305295:0:19436:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789579139.305391:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579139.305398:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305416:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579139.305419:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305427:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579139.305434:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579139.305439:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789579139.305468:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305475:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579139.305491:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305497:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939304366c00/0xd90373d592f220b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220bc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305509:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579139.305512:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305517:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:3.0:1789579139.305520:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305538:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789579139.305544:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579139.305550:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789579139.305563:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305569:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789579139.305575:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305582:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437e00/0xd90373d592f220a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220ae expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579139.305594:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579139.305596:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579139.305598:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579139.305617:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277219968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579139.305648:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579139.305680:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579139.305686:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277220096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579139.305717:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789579139.307023:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579139.307057:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277219712:0@lo:104: 00000100:00100000:1.0:1789579139.307067:0:17134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17134:1876509277219840:0@lo:104: 00010000:00010000:1.0:1789579139.307088:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579139.320086:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277219968 00000100:00100000:1.0:1789579139.320100:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277219968 00010000:00010000:1.0:1789579139.320265:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 24 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579139.321553:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220096 00000100:00100000:1.0:1789579139.321561:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220096 00010000:00010000:1.0:1789579139.321588:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 25 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579139.321607:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579139.321615:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+25:3615:x1876509277219968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579139.321629:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579139.321635:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 25 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.321667:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 25 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.321684:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436800/0xd90373d592f220bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f220b5 expref: 25 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.321712:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579139.321783:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+24:3615:x1876509277219968:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (16134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.321790:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579139.321806:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579139.321812:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+23:3615:x1876509277220096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579139.321819:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579139.321824:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 23 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.321832:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 23 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323056:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363ae800/0xd90373d592f220ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f220a7 expref: 23 pid: 17112 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323073:0:17103:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323082:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789579139.323098:0:17103:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019563179s 00010000:00010000:1.0:1789579139.323113:0:17103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323120:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323332:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323342:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323517:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579139.323523:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323533:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323556:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579139.323568:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579139.323615:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+22:3615:x1876509277220096:12345-0@lo:103:ldlm_bl.0 Request processed in 1803us (17897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579139.323623:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579139.323668:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277220096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579139.323677:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277219968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579139.323739:0:17134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.323748:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579139.323755:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436600/0xd90373d592f2213a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789579139.327081:0:19436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789579139.332654:0:19436:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789579139.332664:0:19436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789579139.332699:0:19436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789579139.332753:0:19436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789579139.332782:0:19436:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789579139.332806:0:19436:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789579139.333679:0:19436:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789579139.336727:0:19436:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789579139.750015:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789579140.004477:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579140.325330:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579120/real 1789579120] req@ffff93930489e680 x1876509277206144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.325421:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93930489e680 x1876509277206144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.325435:0:3614:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789579120/real 1789579120] req@ffff939304197480 x1876509277206272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.325450:0:3614:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939304197480 x1876509277206272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789579140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579140.325473:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579140.325498:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579140.325503:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277206144:0@lo:8:kworker.0 00000100:00080000:1.0:1789579140.325510:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789579140.325516:0:3614:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789579140.325519:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277206272:0@lo:8:kworker.0 00000100:00080000:0.0:1789579140.327947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579140.327956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789579140.327960:0:8:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579140.327970:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1789579140.327978:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789579140.327993:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939407190000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579140.328021:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043ab100 x1876509277220480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579140.328049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579140.328053:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789579140.328055:0:8:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579140.328059:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1789579140.328062:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789579140.328080:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939402ad9000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579140.328094:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9393043aad80 x1876509277220608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789579140.328130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789579140.328133:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789579140.328135:0:8:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789579140.328141:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939436236000 using connection 192.168.203.137@tcp/0@lo 00000100:00100000:0.0:1789579140.328152:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939303a33b80 x1876509277221120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789579140.328816:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277220224:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.328917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.328978:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277220992:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329008:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329032:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277221632:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329064:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329094:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789579140.329102:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277220352:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329127:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329145:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277221248:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329191:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329211:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277221760:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329240:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329274:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277220736:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329298:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329319:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277221376:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329338:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329375:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789579140.329382:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277220864:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329404:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329420:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277221504:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329438:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.329467:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220992 00000100:00100000:1.0:1789579140.329476:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220992 00000100:00100000:1.0:1789579140.329537:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579140.329548:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277220992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329612:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277220992:12345-0@lo:400:kworker.0 Request processed in 66us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.329619:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789579140.329643:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221632 00000100:00100000:1.0:1789579140.329647:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221632 00000100:00100000:1.0:1789579140.329679:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221248 00000100:00100000:1.0:1789579140.329682:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221248 00000100:00100000:1.0:1789579140.329693:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221760 00000100:00100000:1.0:1789579140.329708:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221760 00000100:00100000:1.0:1789579140.329725:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220736 00000100:00100000:1.0:1789579140.329728:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220736 00000100:00100000:1.0:1789579140.329749:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221376 00000100:00100000:1.0:1789579140.329753:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221376 00000100:00100000:1.0:1789579140.329764:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221504 00000100:00100000:1.0:1789579140.329766:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221504 00000100:00100000:1.0:1789579140.329779:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579140.329785:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277221632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329820:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1876509277221632:12345-0@lo:400:kworker.0 Request processed in 35us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.329827:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789579140.329840:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579140.329846:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277221248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329872:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277221248:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.329877:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579140.329890:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579140.329895:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277221760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329922:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277221760:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.329929:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579140.329939:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579140.329944:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277220736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.329973:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277220736:12345-0@lo:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.329978:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789579140.329989:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579140.329995:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277221376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.330050:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277221376:12345-0@lo:400:kworker.0 Request processed in 54us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.330057:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789579140.330069:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789579140.330075:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277221504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.330100:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277221504:12345-0@lo:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.330106:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789579140.330127:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220352 00000100:00100000:1.0:1789579140.330131:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220352 00000100:00100000:1.0:1789579140.330153:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220864 00000100:00100000:1.0:1789579140.330156:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220864 00000100:00100000:1.0:1789579140.330169:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579140.330174:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277220352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.330208:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277220352:12345-0@lo:400:kworker.0 Request processed in 34us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.330214:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579140.330225:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789579140.330231:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277220864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.330256:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277220864:12345-0@lo:400:kworker.0 Request processed in 26us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.330262:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789579140.330297:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579140.330301:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579140.330339:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277220864:0@lo:400:kworker.0 00010000:00080000:1.0:1789579140.330377:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31f80 x1876509277221504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.330396:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277221504:0@lo:400:kworker.0 00010000:00080000:1.0:1789579140.330410:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043a8a80 x1876509277220736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.330420:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277220736:0@lo:400:kworker.0 00010000:00080000:1.0:1789579140.330430:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31c00 x1876509277221376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.330438:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277221376:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.330473:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277220480:0@lo:8:kworker.0 00000100:00100000:1.0:1789579140.330505:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.330531:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277220608:0@lo:8:kworker.0 00000100:00100000:1.0:1789579140.330550:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.330564:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277221120:0@lo:8:kworker.0 00000100:00100000:1.0:1789579140.330581:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.330604:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220480 00000100:00100000:1.0:1789579140.330608:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220480 00000100:00100000:1.0:1789579140.330623:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220608 00000100:00100000:1.0:1789579140.330625:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220608 00000100:00100000:1.0:1789579140.330631:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221120 00000100:00100000:1.0:1789579140.330633:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221120 00000100:00100000:1.0:1789579140.330641:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579140.330645:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277220480:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789579140.330675:0:19143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1789579140.330722:0:19143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22141 00002000:00100000:1.0:1789579140.330739:0:19143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9393023b9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789579140.330749:0:19143:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789579140.330752:0:19143:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789579140.330846:0:19143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789579140.330876:0:19143:0:(import.c:65:import_set_state_nolock()) ffff9393023ba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579140.330917:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277220480:12345-0@lo:8:kworker.0 Request processed in 270us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.330924:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789579140.330938:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579140.330942:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277220608:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789579140.330958:0:19143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1789579140.330975:0:19143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd90373d592f22148 00002000:00100000:1.0:1789579140.330981:0:19143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9393023b8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789579140.330985:0:19143:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789579140.330987:0:19143:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789579140.331150:0:19143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789579140.331166:0:19143:0:(import.c:65:import_set_state_nolock()) ffff9393023bf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579140.331194:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1876509277220608:12345-0@lo:8:kworker.0 Request processed in 250us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.331201:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789579140.331214:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789579140.331219:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3614:x1876509277221120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789579140.331247:0:19143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1789579140.331265:0:19143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd90373d592f2214f 00002000:00100000:1.0:1789579140.331270:0:19143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9393023bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789579140.331274:0:19143:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789579140.331282:0:19143:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789579140.331306:0:19143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789579140.331319:0:19143:0:(import.c:65:import_set_state_nolock()) ffff939303778800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789579140.331347:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3614:x1876509277221120:12345-0@lo:8:kworker.0 Request processed in 126us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.331378:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789579140.331424:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043ab100 x1876509277220480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.331435:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579140.331443:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789579140.331452:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579140.331458:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789579140.331460:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939407190000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579140.331479:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789579140.331484:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277220480:0@lo:8:kworker.0 00010000:00080000:1.0:1789579140.331496:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9393043aad80 x1876509277220608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.331503:0:3614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789579140.331506:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789579140.331511:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579140.331514:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789579140.331516:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939402ad9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579140.331529:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789579140.331532:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3614:1876509277220608:0@lo:8:kworker.0 00010000:00080000:1.0:1789579140.331542:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33b80 x1876509277221120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789579165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789579140.331564:0:3614:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789579140.331568:0:3614:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789579140.331572:0:3614:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789579140.331574:0:3614:0:(import.c:65:import_set_state_nolock()) ffff939436236000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789579140.331583:0:3614:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789579140.331586:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3614:1876509277221120:0@lo:8:kworker.0 00000004:00080000:1.0:1789579140.331646:0:17143:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789579140.331665:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17143:1876509277222016:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789579140.331690:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789579140.332797:0:17144:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789579140.332915:0:17144:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495465563506ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789579140.332924:0:17144:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789579140.332983:0:17861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789579140.333006:0:17861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222272:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789579140.333891:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277220224 00000100:00100000:0.0:1789579140.333903:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277220224 00000100:00100000:0.0:1789579140.333962:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789579140.333973:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:3617:x1876509277220224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579140.334046:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:3617:x1876509277220224:12345-0@lo:400:kworker.0 Request processed in 74us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579140.334053:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:0.0:1789579140.334123:0:17145:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789579140.334143:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17145:1876509277222528:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789579140.334194:0:17860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789579140.334289:0:17860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 495466937205ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789579140.334296:0:17860:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789579140.334910:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579140.334930:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277222400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579140.334976:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789579140.336021:0:17098:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789579140.340981:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222400 00000100:00100000:0.0:1789579140.341003:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222400 00000100:00100000:0.0:1789579140.341103:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789579140.341116:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277222400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579140.341151:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1789579140.341259:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277222400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (6281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579140.341266:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789579140.341343:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789579140.341412:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a32d80 x1876509277222400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.341437:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277222400:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1789579140.345537:0:17849:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1789579140.353148:0:17142:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789579140.353480:0:17142:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 495486128763ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789579140.353489:0:17142:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789579140.353579:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277220352:0@lo:400:kworker.0 00010000:00080000:0.0:1789579140.353599:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a31180 x1876509277221248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.353611:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277221248:0@lo:400:kworker.0 00010000:00080000:0.0:1789579140.353628:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30e00 x1876509277221760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.353636:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277221760:0@lo:400:kworker.0 00000100:00100000:0.0:1789579140.353648:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277220224:0@lo:400:kworker.0 00010000:00080000:0.0:1789579140.353677:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a30380 x1876509277220992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.353686:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277220992:0@lo:400:kworker.0 00010000:00080000:0.0:1789579140.353708:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a33800 x1876509277221632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.353717:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876509277221632:0@lo:400:kworker.0 00000100:00100000:1.0:1789579140.355434:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441963780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579140.355463:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.355485:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394290be780 going to sleep for 11 seconds 00000100:00100000:1.0:1789579140.355506:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222016 00000100:00100000:1.0:1789579140.355515:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222016 00000100:00100000:1.0:1789579140.355569:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222528 00000100:00100000:1.0:1789579140.355571:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222528 00000100:00100000:1.0:1789579140.355590:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579140.355599:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17143:x1876509277222016:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789579140.355867:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277222144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579140.355942:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579140.355969:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579140.355976:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277221888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579140.356005:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579140.356032:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222144 00000100:00100000:0.0:1789579140.356035:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222144 00000100:00100000:0.0:1789579140.356062:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277221888 00000100:00100000:0.0:1789579140.356064:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277221888 00000100:00100000:0.0:1789579140.356090:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789579140.356096:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277222144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789579140.356113:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1789579140.356160:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1876509277222144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579140.356167:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789579140.356539:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579140.356549:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17145:x1876509277222528:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1789579140.359550:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579140.359563:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579140.359596:0:17861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.359644:0:17861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.359941:0:19143:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789579140.359952:0:19143:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789579140.360092:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789579140.360111:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277221888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579140.360156:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579140.361030:0:18623:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789579140.361045:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222272 00000100:00100000:1.0:1789579140.361056:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222272 00000100:00100000:0.0:1789579140.364845:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1876509277221888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4728us (8825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579140.365981:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789579140.366089:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939302b4dc00 x1876509277221888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.366122:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277221888:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789579140.366140:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304197480 x1876509277222144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789579156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789579140.366154:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277222144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579140.368894:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789579140.368922:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17861:x1876509277222272:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789579140.374045:0:17098:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789579140.375190:0:18622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789579140.375203:0:18622:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789579140.375210:0:18622:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:0.0:1789579140.378182:0:18624:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789579140.378199:0:18624:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789579140.378206:0:18624:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:2.0:1789579140.388926:0:19481:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789579140.388943:0:19481:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789579140.389091:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17861:x1876509277222272:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20176us (29494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579140.389104:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789579140.399535:0:17861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304197100 x1876509277222272/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789579156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579140.399561:0:17861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222272:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789579140.399584:0:17861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789579140.399649:0:17861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222656:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789579140.399744:0:17861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579140.399794:0:17861:0:(client.c:2716:ptlrpc_set_wait()) set ffff939437209480 going to sleep for 11 seconds 00000100:00100000:1.0:1789579140.400108:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222656 00000100:00100000:1.0:1789579140.400119:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222656 00000100:00100000:1.0:1789579140.400192:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579140.400203:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17861:x1876509277222656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789579140.400248:0:18623:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789579140.400305:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17861:x1876509277222656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 103us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579140.400324:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789579140.400382:0:17861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5ca80 x1876509277222656/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789579156 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579140.400394:0:17861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222656:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789579140.400404:0:17861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789579140.400444:0:17861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222784:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789579140.400469:0:17861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579140.400485:0:17861:0:(client.c:2716:ptlrpc_set_wait()) set ffff939441963600 going to sleep for 11 seconds 10000000:01000000:3.0:1789579140.401041:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789579140.401048:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93943f640800 from 10 10000000:01000000:3.0:1789579140.401070:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579140.401112:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.401124:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.401136:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579140.401160:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277222912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579140.401226:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.401274:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.401302:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222912 00000100:00100000:3.0:1789579140.401309:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222912 00000100:00100000:3.0:1789579140.401408:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789579140.401420:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277222912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579140.401433:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579140.401448:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c6800/0xd90373d592f2215d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22156 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.401471:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c6800/0xd90373d592f2215d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22156 expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.401482:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c6800/0xd90373d592f2215d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22156 expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.401491:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c6800, rc 0) 00000100:00100000:3.0:1789579140.401530:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277222912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579140.401548:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789579140.403826:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277222784 00000100:00100000:2.0:1789579140.403847:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277222784 00000100:00100000:2.0:1789579140.403927:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579140.403940:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17861:x1876509277222784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789579140.403999:0:19143:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1789579140.406658:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.406673:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.406705:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.406710:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.406718:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.406753:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.406764:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.406773:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.406793:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789579140.408441:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277222912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579140.408468:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.408480:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579140.408556:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789579140.408618:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.408658:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.408680:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223040 00000100:00100000:3.0:1789579140.408687:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223040 00000100:00100000:3.0:1789579140.408736:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789579140.408745:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277223040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789579140.408765:0:17111:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789579140.408780:0:17111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789579140.408784:0:17111:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789579140.408887:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277223040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579140.408895:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789579140.408930:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579140.408982:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579140.408989:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409006:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c7000/0xd90373d592f22156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2215d expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579140.409015:0:17115:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789579140.409017:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff939304130800 from 10 10000000:01000000:3.0:1789579140.409020:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789579140.409041:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409048:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409057:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579140.409069:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579140.409093:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.409108:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.409122:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223168 00000100:00100000:3.0:1789579140.409126:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223168 00000100:00100000:3.0:1789579140.409147:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789579140.409153:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277223168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579140.409162:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579140.409172:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9394421c7c00/0xd90373d592f22172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f2216b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409189:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9394421c7c00/0xd90373d592f22172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f2216b expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409209:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9394421c7c00/0xd90373d592f22172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2216b expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409216:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394421c7c00, rc 0) 00000100:00100000:3.0:1789579140.409245:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277223168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579140.409251:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789579140.409282:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579140.409292:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409299:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579140.409335:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789579140.409382:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.409395:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394071d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.409406:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223296 00000100:00100000:3.0:1789579140.409409:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223296 00000100:00100000:3.0:1789579140.409429:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789579140.409434:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277223296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789579140.409444:0:17112:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789579140.409454:0:17112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789579140.409457:0:17112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789579140.409516:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277223296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579140.409531:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789579140.409560:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277223296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789579140.409593:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789579140.409599:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.409606:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff9394421c7a00/0xd90373d592f2216b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f22172 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419676:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579140.419707:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419726:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.419732:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419746:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419785:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419794:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d019f423/0xd90373d592f22164 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.419857:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.419859:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.419861:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579140.420748:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.420761:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.420779:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.420785:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.420792:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.420807:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.420818:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.420846:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.420879:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.422203:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.422219:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.422232:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.422238:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.422250:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.422285:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.422294:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22179 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.422330:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.422332:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.422334:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579140.431010:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.431030:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.431051:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.431057:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.431064:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.431080:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.431091:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.431099:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.431125:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789579140.442712:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.442730:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442773:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.442778:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.442787:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442808:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442820:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442829:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442859:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789579140.442876:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579140.442941:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442951:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.442957:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.442966:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443002:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443010:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bafbcc/0xd90373d592f22180 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443036:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.443040:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443047:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.443050:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443059:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443071:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443079:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038e19273/0xd90373d592f22187 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.443100:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.443102:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.443112:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579140.445207:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.445222:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448418:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.448426:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.448438:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448459:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448476:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448484:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448527:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.448547:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.448555:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448565:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.448570:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448603:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448624:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448632:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b737ec1/0xd90373d592f2218e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.448664:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.448667:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.448669:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579140.455539:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.455558:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455583:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.455589:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.455598:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455616:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455628:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455651:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455868:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.455889:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.455897:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455906:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.455915:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455926:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455946:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455954:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a9c971/0xd90373d592f22195 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.455977:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.455979:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.455981:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789579140.458425:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789579140.458457:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458477:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.458483:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.458491:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458509:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458521:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458530:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458557:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.458571:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.458578:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458586:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afe00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.458591:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458601:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458632:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458641:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000704b81c8/0xd90373d592f2219c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.458672:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.458675:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.458678:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.459832:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.466939:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1789579140.466946:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.466956:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.466961:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.466994:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1789579140.466998:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.467003:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.467007:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.467014:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.467017:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.467057:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.467066:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.467071:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.467095:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.467097:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.467132:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.467146:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.467185:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789579140.467906:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579140.467916:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.467927:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.467933:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.467944:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.467966:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.467980:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc4ff01/0xd90373d592f221a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468005:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579140.468009:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468015:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.468018:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468027:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468036:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468043:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009175fcf/0xd90373d592f221aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.468057:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.468059:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.468060:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.469340:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579140.472341:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.472381:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.472413:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.472418:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.472426:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.472444:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.472456:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.472466:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.472493:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.473050:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.473063:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.473097:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.473102:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.473113:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.473138:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.473147:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.473183:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.473186:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.473191:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.476040:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.476062:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.476086:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.476092:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.476100:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.476119:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.476133:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.476142:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.476175:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.476745:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.476760:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.476775:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.476779:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.476792:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.476830:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.476838:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db901def/0xd90373d592f221b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.476866:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.477034:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.477039:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.478093:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.478102:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.478116:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.478120:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.478126:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.478136:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.478145:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.478152:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.478193:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579140.478218:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579140.478245:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.478258:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.478263:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.478274:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.478307:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.478315:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7f1fb9/0xd90373d592f221bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.478337:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.478339:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.478340:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.480806:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.480824:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.480853:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.480859:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.480867:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.480996:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.481011:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.481020:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.481091:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579140.483215:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.483228:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.483245:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.483250:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.483255:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.483269:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.483297:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.483306:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789579140.483503:0:19437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789579140.483532:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789579140.483537:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789579140.486051:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17861:x1876509277222784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 82100us (85567us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789579140.486067:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579140.486145:0:17861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789579140.486155:0:17861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17861:1876509277222784:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789579140.486190:0:17861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789579140.488101:0:17861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17861:1876509277223424:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789579140.488194:0:17861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1789579140.488967:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.488981:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.489000:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.489006:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.489014:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.489032:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.489061:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.489069:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579140.492085:0:17861:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410355a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789579140.492138:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223424 00000100:00100000:2.0:1789579140.492150:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223424 00000100:00100000:2.0:1789579140.492608:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789579140.492622:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17861:x1876509277223424:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789579140.492750:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17861:x1876509277223424:12345-0@lo:900:osp-pre-1-1.0 Request processed in 131us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579140.492759:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789579140.492807:0:17861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303a5ca80 x1876509277223424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789579156 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579140.492823:0:17861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17861:1876509277223424:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789579140.496651:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789579140.496672:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496690:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.496707:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496721:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496750:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496758:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389436e9/0xd90373d592f221c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496850:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579140.496856:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496864:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.496868:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496875:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496888:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496897:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579140.496901:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496908:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.496911:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496919:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496943:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.496951:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.496953:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.496955:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.497804:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789579140.497819:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.499752:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789579140.499769:0:18624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000862027f5/0xd90373d592f221d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.500201:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.501565:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.501584:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501601:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.501606:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.501613:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501629:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501639:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501647:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501666:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.501679:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.501685:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501692:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.501707:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501717:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501745:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501753:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f221db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.501776:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.501779:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.501781:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.503136:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.503267:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.503279:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.503298:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.503303:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.503310:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.503326:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.503337:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.503401:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.503425:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.503648:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.503658:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.503667:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.503673:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.503684:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.503718:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.503727:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b930c20/0xd90373d592f221e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.503748:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.503751:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.503752:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579140.504169:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.504177:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504189:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.504193:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.504199:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504213:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579140.504214:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.504237:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.504243:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504253:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504305:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.504438:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.504446:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.504452:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.504482:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.504494:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.504503:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.504560:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789579140.504905:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789579140.504913:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504925:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.504929:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504939:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504956:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.504964:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef19528/0xd90373d592f221e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.504981:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579140.504984:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.504985:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.504987:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.504988:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.504996:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.505000:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505022:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505034:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505041:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009709db03/0xd90373d592f221f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505060:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.505062:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.505064:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.505319:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.505328:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505339:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.505343:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.505348:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505398:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505409:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505416:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505436:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579140.505734:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.505740:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505748:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.505758:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.505762:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505772:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505779:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505786:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.505806:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789579140.505839:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579140.505847:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505858:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.505862:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505872:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505962:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.505984:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e2219bb/0xd90373d592f221f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506005:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.506009:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506015:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.506018:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506026:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506036:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506043:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e6c9eae/0xd90373d592f221fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506055:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.506057:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.506059:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.506307:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.506466:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.506474:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506486:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.506491:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.506496:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506508:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506516:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506524:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506540:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.506776:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.506782:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506796:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.506800:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506808:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506822:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506830:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9dc6ab0/0xd90373d592f22205 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.506858:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.506859:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.506861:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.506957:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.506963:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506979:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.506982:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.506986:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.506995:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.507003:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.507009:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.507030:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789579140.507245:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579140.507252:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507260:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.507263:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507285:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507314:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507323:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002f6dea6/0xd90373d592f2220c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507346:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.507374:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579140.507376:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.507454:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.507466:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.507480:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.507484:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.507489:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.507501:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.507510:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.507528:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.507549:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789579140.507573:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.507582:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.507591:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.507594:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.507602:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.507623:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.507631:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000816584e8/0xd90373d592f22213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.507650:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.507652:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.507655:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579140.507959:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.507966:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507976:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.507980:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.507984:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.507994:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.508003:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.508018:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.508043:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579140.509384:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.509397:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.509412:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.509417:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.509423:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.509437:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.509608:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.509618:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.509907:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789579140.512054:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1789579140.514413:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.514429:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.514461:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.514466:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.514472:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.514487:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.514498:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.514507:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.514521:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789579140.515061:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.515067:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515076:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.515080:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.515084:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515093:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515116:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515124:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515134:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789579140.515469:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.515476:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515485:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.515488:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.515492:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515502:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515525:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515533:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.515555:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789579140.516145:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.516152:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516160:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.516163:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.516167:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516177:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516185:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516192:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516201:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789579140.516606:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.516612:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516621:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.516630:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.516634:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516644:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516651:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516658:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.516665:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789579140.517451:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.517459:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.517470:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.517473:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.517477:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.517488:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.517497:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.517512:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.517527:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1789579140.518578:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.518586:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.518597:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.518601:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.518605:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.518616:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.518624:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.518630:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.518640:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1789579140.518923:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.518943:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:0.0:1789579140.518949:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.518962:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.518988:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.518997:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c67ba499/0xd90373d592f2221a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789579140.519449:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.519458:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.519475:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.519478:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.519484:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.519495:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.519503:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.519511:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519521:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1789579140.519524:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1789579140.519531:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519542:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.519546:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519559:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519573:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519581:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e53cfe0/0xd90373d592f22221 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519624:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789579140.519630:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519637:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.519640:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519648:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519660:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519668:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d609a2/0xd90373d592f22228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519683:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789579140.519687:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519702:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.519706:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519727:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519739:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519745:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067b1bb96/0xd90373d592f2222f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519759:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789579140.519763:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519771:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.519774:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519892:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519908:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519915:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe045ca7/0xd90373d592f22236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519940:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789579140.519944:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519950:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.519953:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519961:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519971:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519978:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001857386f/0xd90373d592f2223d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519990:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789579140.519994:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.519999:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.520002:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520021:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520032:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520038:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088a62c69/0xd90373d592f22244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520050:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789579140.520054:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520060:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.520063:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520082:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520093:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.520100:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae4ea38/0xd90373d592f2224b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.520249:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789579140.522937:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789579140.522946:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.522955:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579140.522961:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.522975:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.523006:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.523015:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1057be7/0xd90373d592f22259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.523028:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.523031:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.523034:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789579140.524874:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.524905:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789579140.524939:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.524945:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.524948:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.524954:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.524954:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.524958:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.524963:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.524963:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.524979:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.524979:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.524991:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.524999:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.525001:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.525007:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.525064:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789579140.526467:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789579140.527643:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.527657:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.527677:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.527681:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.527688:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.527723:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.527751:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.527759:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.527772:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789579140.528414:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.528422:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.528432:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.528435:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.528440:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.528460:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.528468:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.528476:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.528499:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789579140.529532:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789579140.529544:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.529559:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1789579140.529562:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579140.529567:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.529580:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.529590:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.529598:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579140.529609:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1789579140.529674:0:18622:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00002000:00010000:3.0:1789579140.533152:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.533165:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.533181:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.533185:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.533190:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.533205:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.533232:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.533240:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.533252:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789579140.535893:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789579140.535912:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.535930:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.535936:0:19485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.535950:0:19485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.535971:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.535983:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536003:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.536007:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f22267 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536011:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536055:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536077:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536084:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5b1c85/0xd90373d592f22252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536114:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789579140.536118:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536139:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.536142:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536150:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536159:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536165:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef19528/0xd90373d592f22260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536179:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789579140.536182:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536188:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.536193:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536201:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.536207:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789579140.536211:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536234:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47208ff/0xd90373d592f2226e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536253:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579140.536256:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536263:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.536266:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536285:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536296:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536304:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9a911b8/0xd90373d592f2227c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536316:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.536319:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536326:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.536335:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536343:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536380:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536387:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fcb8643/0xd90373d592f22283 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.536400:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.536402:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.536405:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.537302:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.537312:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537325:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.537330:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.537336:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537379:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537390:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537407:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537428:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.537440:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.537444:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537451:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36a00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.537455:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.537458:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537467:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.537491:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.537499:0:19485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537500:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.537542:0:19485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579140.537545:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17145:x1876509277222528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 180986us (182072us total) trans 0 rc 0/0 00010000:00010000:3.0:1789579140.537547:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816584e8/0xd90373d592f2228a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.537569:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579140.537569:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789579140.537577:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003a9d201/0xd90373d592f22275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.537581:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.537587:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.537593:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.537620:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.537624:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.537630:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579140.537660:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17145:1876509277222528:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789579140.537687:0:17145:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789579140.537745:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17145:1876509277223552:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789579140.537802:0:17145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579140.537845:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579140.538173:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223552 00000100:00100000:0.0:1789579140.538187:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223552 00000100:00100000:0.0:1789579140.538240:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789579140.538250:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17145:x1876509277223552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789579140.538300:0:19481:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:3.0:1789579140.539157:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.539166:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539180:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.539184:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.539189:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539203:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539214:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539222:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539240:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.539249:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.539253:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539284:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.539289:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539299:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539314:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539322:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e6c9eae/0xd90373d592f22291 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539340:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.539342:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.539343:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.539773:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.539779:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539788:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.539792:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.539796:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539807:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539821:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539828:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.539847:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579140.540199:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579140.540214:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.540227:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36200 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.540441:0:19485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.540475:0:19485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.540496:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.540506:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e2219bb/0xd90373d592f22298 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.540539:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.540542:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.540545:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.540940:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.540950:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.540963:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.540967:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.540972:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.540983:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.540992:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.540999:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.541037:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789579140.541440:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579140.541452:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.541466:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a36400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.541471:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.541483:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.541504:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.541532:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009709db03/0xd90373d592f2229f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.541564:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.541566:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.541569:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.542576:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.542585:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.542599:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.542603:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.542608:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.542620:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.542629:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.542637:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.542660:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789579140.543332:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.543339:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543368:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.543378:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.543383:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543393:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543402:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543409:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543424:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789579140.543982:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.543989:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.543999:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.544002:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.544007:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.544017:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.544025:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.544038:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.544047:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789579140.544996:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.545004:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545015:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.545018:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.545023:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545033:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545042:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545050:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545058:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789579140.545460:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.545466:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545480:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.545483:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.545488:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545497:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545505:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545513:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.545521:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1789579140.545860:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17145:x1876509277223552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7607us (8052us total) trans 8589934594 rc 0/0 00010000:00010000:1.0:1789579140.545884:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789579140.545900:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.545913:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.545919:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.545930:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.545954:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.545962:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c7f1fb9/0xd90373d592f222a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.546000:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789579140.546004:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579140.546010:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17145:1876509277223552:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789579140.546027:0:17145:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1789579140.546030:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303a37e00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.546037:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.546046:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.546059:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.546067:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc4ff01/0xd90373d592f222ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.546088:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:3.0:1789579140.546091:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.546094:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546100:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546111:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.546114:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.546118:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546141:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546149:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546156:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546166:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1789579140.546342:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:3.0:1789579140.546618:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.546623:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546631:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.546634:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.546637:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546646:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546652:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546669:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546678:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789579140.546969:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.546975:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546983:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.546986:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.546990:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.546999:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.547007:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.547014:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.547022:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789579140.548212:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.548222:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.548230:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789579140.548247:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548249:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.548261:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579140.548280:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afe00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548291:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548305:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548314:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.548326:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548330:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548419:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789579140.548427:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.548452:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.548460:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000704b81c8/0xd90373d592f222bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548569:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789579140.548577:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548586:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548591:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548600:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548628:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548635:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a9c971/0xd90373d592f222c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548654:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789579140.548657:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548662:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae800 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548665:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548671:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548679:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548686:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b737ec1/0xd90373d592f222c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548707:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789579140.548711:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548723:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548726:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548732:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548742:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548748:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e19273/0xd90373d592f222d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548760:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789579140.548764:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548769:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548773:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548780:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548789:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548802:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8bafbcc/0xd90373d592f222d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548812:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.548815:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548821:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.548823:0:17106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548830:0:17106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548839:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548846:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a044a7af/0xd90373d592f222de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.548862:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.548864:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.548884:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.548889:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.548899:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.548914:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.548932:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d019f423/0xd90373d592f222b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.548954:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.548956:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.548958:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579140.548968:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.549701:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789579140.552197:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789579140.552214:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.552235:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1789579140.552241:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789579140.552249:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.552266:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.552277:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.552287:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.552473:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789579140.552537:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579140.552551:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.552579:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519c00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579140.552585:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.552595:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.552618:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.552626:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000086051e6/0xd90373d592f222e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.552652:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.552654:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579140.552656:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789579140.562831:0:18624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789579140.562851:0:18624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.562874:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1789579140.562880:0:18624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789579140.562888:0:18624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.562906:0:18624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.562938:0:18624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.562947:0:18624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579140.563030:0:18624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789579140.563162:0:18624:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789579140.563750:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17143:x1876509277222016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 207692us (231599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579140.563762:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579140.566274:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17143:1876509277222016:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789579140.566301:0:17143:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789579140.566395:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17143:1876509277223680:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789579140.566472:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579140.566513:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff939410355a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789579140.566527:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223680 00000100:00100000:3.0:1789579140.566537:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223680 00000100:00100000:3.0:1789579140.566604:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789579140.566615:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17143:x1876509277223680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789579140.566669:0:19143:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1789579140.575631:0:19485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579140.575649:0:19485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.575667:0:19485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2f000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579140.575673:0:19485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.575685:0:19485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.575720:0:19485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579140.575729:0:19485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ff4df6/0xd90373d592f222ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579140.581424:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.581431:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579140.581434:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789579140.591681:0:18619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1789579140.591734:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789579140.591938:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17143:x1876509277223680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25321us (25462us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789579140.591949:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789579140.592603:0:17143:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789579140.592614:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17143:1876509277223680:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789579140.592632:0:17143:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:0.0:1789579140.715556:0:19505:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789579140.715838:0:19505:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789579141.027499:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579141.478856:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579141.478903:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277223808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579141.479016:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579141.479121:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223808 00000100:00100000:2.0:1789579141.479133:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223808 00000100:00100000:2.0:1789579141.479220:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579141.479232:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277223808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579141.479262:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789579141.479311:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579141.479323:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277223808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579141.479331:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789579141.479440:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277223808:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789579142.052523:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579143.016714:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277223936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579143.016781:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579143.016932:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277223936 00000100:00100000:2.0:1789579143.016940:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277223936 00000100:00100000:2.0:1789579143.016984:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579143.016993:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277223936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789579143.017027:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789579143.017145:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277223936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579143.017153:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789579143.017742:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277223936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579143.018746:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277224064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579143.018803:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579143.018855:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224064 00000100:00100000:1.0:1789579143.018860:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224064 00000100:00100000:1.0:1789579143.018899:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789579143.018909:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277224064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579143.018947:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579143.018992:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277224064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579143.018999:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789579143.019010:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277224064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789579143.075945:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579144.102780:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579145.124499:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579145.571534:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277224320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579145.571600:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.571633:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277224448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579145.571681:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.571780:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579145.571787:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277224576:0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.571832:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.571927:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224320 00000100:00100000:3.0:1789579145.571934:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224320 00000100:00100000:3.0:1789579145.571983:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224448 00000100:00100000:3.0:1789579145.571986:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224448 00000100:00100000:3.0:1789579145.572007:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789579145.572016:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277224320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579145.572032:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:3.0:1789579145.572042:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789579145.572046:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277224192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579145.572079:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.572096:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277224320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579145.572110:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789579145.572119:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277224320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579145.572128:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224192 00000100:00100000:3.0:1789579145.572133:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224192 00000100:00100000:3.0:1789579145.572153:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579145.572159:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277224448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579145.572169:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789579145.572205:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277224448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579145.572211:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579145.572223:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789579145.572229:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277224192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789579145.572243:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579145.572281:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277224192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579145.572287:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789579145.572313:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224576 00000100:00100000:3.0:1789579145.572317:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224576 00000100:00100000:3.0:1789579145.572340:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789579145.572346:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3615:x1876509277224576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.572692:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3615:x1876509277224576:12345-0@lo:400:kworker.0 Request processed in 344us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579145.572699:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789579145.572730:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789579145.572735:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579145.573009:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277224704:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.573044:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579145.573070:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277225216:0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.573086:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224704 00000100:00100000:3.0:1789579145.573092:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224704 00000100:00100000:3.0:1789579145.573127:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789579145.573128:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.573137:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277224704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.573153:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277225728:0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.573192:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277224704:12345-0@lo:400:kworker.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579145.573200:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.573204:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789579145.573381:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277224704:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.573398:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789579145.573407:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277224832:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573438:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225216 00000100:00100000:1.0:1789579145.573443:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225216 00000100:00100000:1.0:1789579145.573487:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225728 00000100:00100000:1.0:1789579145.573491:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225728 00000100:00100000:1.0:1789579145.573516:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789579145.573523:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277225216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573559:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1876509277225216:12345-0@lo:400:kworker.0 Request processed in 36us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579145.573565:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789579145.573578:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579145.573584:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277225728:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789579145.573592:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579145.573612:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1876509277225728:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579145.573619:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789579145.573646:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277224960:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573689:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579145.573708:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277225472:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573726:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579145.573744:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225472 00000100:00100000:3.0:1789579145.573747:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225472 00000100:00100000:1.0:1789579145.573749:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277224576:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573764:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277224448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579145.573779:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789579145.573785:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277225088:0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.573788:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789579145.573794:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277225472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.573809:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579145.573827:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277225600:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.573881:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579145.573905:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277225344:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.573931:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789579145.573956:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091fc380 x1876509277225216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579145.573968:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3617:1876509277225216:0@lo:400:kworker.0 00010000:00080000:2.0:1789579145.573980:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091fe680 x1876509277225728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579145.573988:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3617:1876509277225728:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.574062:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224832 00000100:00100000:2.0:1789579145.574067:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224832 00000100:00100000:2.0:1789579145.574085:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225344 00000100:00100000:2.0:1789579145.574088:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225344 00000100:00100000:2.0:1789579145.574104:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789579145.574175:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277224832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.574215:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277224832:12345-0@lo:400:kworker.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579145.574222:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789579145.574296:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789579145.574303:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277225344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.574337:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277225344:12345-0@lo:400:kworker.0 Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579145.574343:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789579145.574407:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091fc000 x1876509277224832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579145.574408:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579145.574421:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277224832:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.574444:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277224960 00010000:00080000:2.0:1789579145.574449:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091fdc00 x1876509277225344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579145.574449:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277224960 00000100:00100000:2.0:1789579145.574461:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277225344:0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.574484:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225600 00000100:00100000:2.0:1789579145.574487:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225600 00000100:00100000:2.0:1789579145.574597:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789579145.574605:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277225600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579145.574640:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277225600:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579145.574646:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789579145.574686:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091ffb80 x1876509277225600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579145.574696:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277225600:0@lo:400:kworker.0 00000100:00100000:3.0:1789579145.574961:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277225472:12345-0@lo:400:kworker.0 Request processed in 1165us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579145.574971:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789579145.574990:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9394091fe300 x1876509277225472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789579145.574995:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579145.574999:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579145.575004:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277225472:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.575314:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789579145.575326:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277224960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.575401:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277224960:12345-0@lo:400:kworker.0 Request processed in 79us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579145.575408:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789579145.575431:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225088 00000100:00100000:1.0:1789579145.575512:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225088 00000100:00100000:1.0:1789579145.575563:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789579145.575571:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277225088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.575609:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277225088:12345-0@lo:400:kworker.0 Request processed in 38us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579145.575615:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789579145.575636:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579145.575686:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939302b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277224192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579145.575712:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277225088:0@lo:400:kworker.0 00000100:00100000:1.0:1789579145.575721:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277224960:0@lo:400:kworker.0 00000001:00080000:3.0:1789579145.575933:0:19437:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:02000400:2.0:1789579146.031478:0:19795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg337-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789579146.147608:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579146.598383:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579146.598408:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277225856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579146.598461:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579146.598496:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225856 00000100:00100000:3.0:1789579146.598502:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225856 00000100:00100000:3.0:1789579146.598539:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579146.598547:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277225856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579146.598568:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579146.598610:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277225856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579146.598616:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579146.598675:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277225856:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1789579146.973016:0:19847:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789579146.977785:0:19847:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789579147.185413:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789579147.560973:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789579148.141752:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277225984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579148.141818:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579148.141867:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789579148.141874:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277226112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579148.141922:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579148.145772:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277225984 00000100:00100000:3.0:1789579148.145787:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277225984 00000100:00100000:3.0:1789579148.145839:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226112 00000100:00100000:3.0:1789579148.145843:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226112 00000100:00100000:3.0:1789579148.145863:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579148.145872:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277225984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789579148.145910:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579148.145989:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277225984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579148.145996:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579148.146012:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579148.146018:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277226112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579148.146034:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789579148.146059:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277226112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579148.146065:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579148.146124:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277226112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579148.146139:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277225984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579148.197344:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789579148.384836:0:19897:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789579148.385068:0:19897:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789579148.820130:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579148.822329:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417472 00000100:00100000:0.0:1789579148.822436:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417472 00000100:00100000:0.0:1789579148.822509:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:0.0:1789579148.822520:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2391:x1876509261417472:12345-192.168.203.37@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789579148.822557:0:17113:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2f7f6d69-9306-485c-8954-48c3fbe6cf31@192.168.203.37@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1789579148.822596:0:17113:0:(genops.c:1384:class_connect()) connect: client 2f7f6d69-9306-485c-8954-48c3fbe6cf31, cookie 0xd90373d592f222f3 00000100:00080000:0.0:1789579148.822783:0:17113:0:(import.c:65:import_set_state_nolock()) ffff9393048c1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579148.822890:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+5:2391:x1876509261417472:12345-192.168.203.37@tcp:250:mount.lustre.0 Request processed in 369us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579148.822899:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 115 00000100:00100000:0.0:1789579148.846706:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579148.846829:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417600 00000100:00100000:3.0:1789579148.846843:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417600 00000100:00100000:3.0:1789579148.846918:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:3.0:1789579148.846929:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+5:14864:x1876509261417600:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789579148.846951:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579148.846974:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2e800/0xd90373d592f222fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec2b0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579148.847007:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2e800/0xd90373d592f222fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b0 expref: 6 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579148.847020:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2e800/0xd90373d592f222fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b0 expref: 6 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579148.847030:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e800, rc 0) 00000100:00100000:3.0:1789579148.847111:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+6:14864:x1876509261417600:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 183us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579148.847118:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 116 00000100:00100000:1.0:1789579148.873153:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579148.873453:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417728 00000100:00100000:3.0:1789579148.873468:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417728 00000100:00100000:3.0:1789579148.873544:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:3.0:1789579148.873554:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+6:14864:x1876509261417728:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789579148.873727:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+6:14864:x1876509261417728:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 173us (587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789579148.873755:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 117 00000100:00100000:0.0:1789579148.889001:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579148.896062:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417856 00000100:00100000:3.0:1789579148.896086:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417856 00000100:00100000:0.0:1789579148.896413:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:0.0:1789579148.896429:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+6:14864:x1876509261417856:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789579148.896454:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579148.896479:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436a00/0xd90373d592f22301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec2b7 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579148.896536:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436a00/0xd90373d592f22301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b7 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579148.896549:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436a00/0xd90373d592f22301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2b7 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579148.896559:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436a00, rc 0) 00000100:00100000:0.0:1789579148.896660:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+7:14864:x1876509261417856:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 234us (7671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579148.896667:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 118 00000100:00100000:2.0:1789579148.914275:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579148.914621:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261417984 00000100:00100000:0.0:1789579148.914647:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261417984 00000100:00100000:0.0:1789579148.914718:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:0.0:1789579148.914729:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+7:14864:x1876509261417984:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789579148.914941:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14864:x1876509261417984:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 213us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579148.914950:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 119 00000100:00100000:1.0:1789579148.921520:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579148.921853:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418112 00000100:00100000:3.0:1789579148.921868:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418112 00000100:00100000:3.0:1789579148.921940:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:3.0:1789579148.921952:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14864:x1876509261418112:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789579148.922453:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14864:x1876509261418112:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 502us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579148.922464:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 120 00000100:00100000:1.0:1789579148.938755:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579148.939558:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418240 00000100:00100000:3.0:1789579148.939574:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418240 00000100:00100000:3.0:1789579148.939658:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:3.0:1789579148.939671:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418240:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789579148.940120:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418240:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 451us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579148.940129:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 121 00000100:00100000:2.0:1789579149.007901:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.008024:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418368 00000100:00100000:0.0:1789579149.008039:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418368 00000100:00100000:0.0:1789579149.008112:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:0.0:1789579149.008123:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418368:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579149.008395:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418368:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 272us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.008404:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 122 00000100:00100000:1.0:1789579149.018790:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579149.019569:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418496 00000100:00100000:3.0:1789579149.019584:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418496 00000100:00100000:3.0:1789579149.019671:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:3.0:1789579149.019684:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418496:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789579149.019888:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14883:x1876509261418496:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 206us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.019897:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 123 00000100:00100000:1.0:1789579149.051150:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579149.051729:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418624 00000100:00100000:3.0:1789579149.051762:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418624 00000100:00100000:3.0:1789579149.051850:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:3.0:1789579149.051862:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+8:14864:x1876509261418624:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789579149.051884:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579149.051907:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f800/0xd90373d592f22308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec2e8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579149.051943:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f800/0xd90373d592f22308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2e8 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579149.051957:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f800/0xd90373d592f22308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2e8 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579149.051968:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f800, rc 0) 00000100:00100000:3.0:1789579149.052046:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+9:14864:x1876509261418624:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 185us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.052053:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 124 00000100:00100000:2.0:1789579149.055716:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.055838:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418752 00000100:00100000:0.0:1789579149.055870:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418752 00000100:00100000:0.0:1789579149.055938:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:0.0:1789579149.055950:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+9:14864:x1876509261418752:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789579149.055982:0:17111:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789579149.056003:0:17111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789579149.056008:0:17111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789579149.056012:0:17111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789579149.056015:0:17111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789579149.056017:0:17111:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789579149.063610:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+9:14864:x1876509261418752:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 7644us (7889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.063629:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 125 00000100:00100000:1.0:1789579149.069238:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.069447:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261418880 00000100:00100000:0.0:1789579149.069460:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261418880 00000100:00100000:0.0:1789579149.069532:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:0.0:1789579149.069545:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+9:14864:x1876509261418880:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789579149.069568:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579149.069590:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec2ef expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579149.069627:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 10 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579149.069652:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 10 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579149.069662:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436800, rc 0) 00000100:00100000:0.0:1789579149.069736:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14864:x1876509261418880:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 193us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.069764:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 126 00000100:00100000:2.0:1789579149.072435:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.072613:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419008 00000100:00100000:0.0:1789579149.072627:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419008 00000100:00100000:0.0:1789579149.072700:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:0.0:1789579149.072713:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939410173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14864:x1876509261419008:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789579149.073083:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939410173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14864:x1876509261419008:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 371us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.073091:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 127 00000100:00100000:1.0:1789579149.091682:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579149.091992:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419136 00000100:00100000:3.0:1789579149.092005:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419136 00000100:00100000:3.0:1789579149.092079:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:3.0:1789579149.092091:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14864:x1876509261419136:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789579149.094136:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14864:x1876509261419136:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 2034us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.094152:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 128 00000100:00100000:1.0:1789579149.098512:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.098616:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419264 00000100:00100000:0.0:1789579149.098639:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419264 00000100:00100000:0.0:1789579149.098715:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:0.0:1789579149.098728:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14889:x1876509261419264:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579149.098957:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14889:x1876509261419264:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 231us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.098966:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 129 00000100:00100000:2.0:1789579149.134715:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579149.140431:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419392 00000100:00100000:3.0:1789579149.140454:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419392 00000100:00100000:3.0:1789579149.140532:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:3.0:1789579149.140545:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14889:x1876509261419392:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789579149.140785:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14889:x1876509261419392:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 242us (6086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.140794:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 130 00000100:00100000:1.0:1789579149.167474:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579149.167532:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579149.167702:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419520 00000100:00100000:3.0:1789579149.167715:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419520 00000100:00100000:3.0:1789579149.167762:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419776 00000100:00100000:3.0:1789579149.167765:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419776 00000100:00100000:3.0:1789579149.167789:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579149.167799:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876509261419520:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789579149.167835:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1789579149.167898:0:17120:0:(genops.c:1384:class_connect()) connect: client fb59b6f8-2a36-456b-b988-f5328ecc7957, cookie 0xd90373d592f22316 00000004:00100000:3.0:1789579149.167932:0:17120:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789579149.168214:0:17120:0:(import.c:65:import_set_state_nolock()) ffff9393034fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579149.168296:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2391:x1876509261419520:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 496us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.168305:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579149.168326:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:3.0:1789579149.168332:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876509261419776:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789579149.168381:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1789579149.168417:0:17120:0:(genops.c:1384:class_connect()) connect: client fb59b6f8-2a36-456b-b988-f5328ecc7957, cookie 0xd90373d592f2231d 00000004:00100000:3.0:1789579149.168431:0:17120:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789579149.168588:0:17120:0:(import.c:65:import_set_state_nolock()) ffff9393034fb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579149.168616:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2391:x1876509261419776:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 283us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.168624:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789579149.200596:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579149.200648:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579149.200685:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.200787:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420032 00000100:00100000:0.0:1789579149.200799:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420032 00000100:00100000:0.0:1789579149.200871:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419904 00000100:00100000:0.0:1789579149.200874:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419904 00000100:00100000:0.0:1789579149.200888:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261419648 00000100:00100000:0.0:1789579149.200891:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261419648 00000100:00100000:0.0:1789579149.200904:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789579149.200914:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:14864:x1876509261420032:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789579149.200966:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789579149.201060:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:14864:x1876509261420032:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 147us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.201083:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:0.0:1789579149.201102:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789579149.201108:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:0:x1876509261419904:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789579149.201124:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789579149.201157:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939302b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:0:x1876509261419904:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.201163:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:0.0:1789579149.201173:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:0.0:1789579149.201178:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:0:x1876509261419648:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789579149.201197:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789579149.201216:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:0:x1876509261419648:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 38us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.201222:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00080000:1.0:1789579149.201473:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579149.201478:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579149.209278:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.209445:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420160 00000100:00100000:0.0:1789579149.209458:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420160 00000100:00100000:0.0:1789579149.209534:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:0.0:1789579149.209545:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420160:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789579149.209684:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420160:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 141us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.209691:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:1.0:1789579149.219053:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579149.219100:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579149.219140:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.219459:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420288 00000100:00100000:0.0:1789579149.219473:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420288 00000100:00100000:0.0:1789579149.219516:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420416 00000100:00100000:0.0:1789579149.219519:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420416 00000100:00100000:0.0:1789579149.219568:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579149.219578:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261420288:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789579149.219620:0:18624:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1789579149.219669:0:18624:0:(genops.c:1384:class_connect()) connect: client fb59b6f8-2a36-456b-b988-f5328ecc7957, cookie 0xd90373d592f22324 00002000:00100000:0.0:1789579149.219687:0:18624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb59b6f8-2a36-456b-b988-f5328ecc7957/ffff9393048c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789579149.219710:0:18624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789579149.219923:0:18624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789579149.219963:0:18624:0:(import.c:65:import_set_state_nolock()) ffff9393048c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789579149.220038:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2391:x1876509261420288:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 460us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.220046:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579149.220065:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789579149.220070:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876509261420416:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789579149.220087:0:18624:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fb59b6f8-2a36-456b-b988-f5328ecc7957@192.168.203.37@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1789579149.220105:0:18624:0:(genops.c:1384:class_connect()) connect: client fb59b6f8-2a36-456b-b988-f5328ecc7957, cookie 0xd90373d592f2232b 00002000:00100000:0.0:1789579149.220110:0:18624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb59b6f8-2a36-456b-b988-f5328ecc7957/ffff9393048c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789579149.220122:0:18624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789579149.221096:0:18624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789579149.221123:0:18624:0:(import.c:65:import_set_state_nolock()) ffff9393048c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789579149.221444:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420544 00000100:00100000:3.0:1789579149.221453:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420544 00000100:00100000:3.0:1789579149.221515:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789579149.221524:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420544:12345-192.168.203.37@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789579149.221577:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420544:12345-192.168.203.37@tcp:900:mount.lustre.0 Request processed in 55us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579149.221585:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00010000:00010000:2.0:1789579149.222621:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579149.223387:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2391:x1876509261420416:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 3304us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.223400:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789579149.231718:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579149.233075:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420672 00000100:00100000:0.0:1789579149.233092:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420672 00000100:00100000:2.0:1789579149.233336:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:2.0:1789579149.233392:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420672:12345-192.168.203.37@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789579149.246718:0:17122:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13219us 00000004:00200000:0.0:1789579149.306206:0:17122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789579149.306427:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14864:x1876509261420672:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 73071us (74714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579149.306440:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:1.0:1789579149.614094:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579149.614302:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420800 00000100:00100000:2.0:1789579149.614317:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420800 00000100:00100000:2.0:1789579149.614441:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:2.0:1789579149.614452:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14912:x1876509261420800:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:2.0:1789579149.614478:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579149.614528:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031c00/0xd90373d592f22332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec320 expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614619:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614733:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614750:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579149.614808:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789579149.614812:0:18390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579149.614869:0:18390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614901:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031c00/0xd90373d592f22332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec320 expref: 8 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614924:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec320 expref: 7 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579149.614934:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:2.0:1789579149.614937:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789579149.614942:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031200, rc 0) 00000100:00100000:2.0:1789579149.615024:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:14912:x1876509261420800:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 574us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579149.615032:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000040:00080000:3.0:1789579149.988145:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579150.244411:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579150.691823:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277226240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579150.691894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579150.692259:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277226496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579150.692325:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579150.692411:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226240 00000100:00100000:3.0:1789579150.692421:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226240 00000100:00100000:3.0:1789579150.692481:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226496 00000100:00100000:3.0:1789579150.692484:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226496 00000100:00100000:3.0:1789579150.692505:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579150.692515:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277226240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579150.693806:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277226368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579150.693874:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789579150.694077:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789579150.696716:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277226752:0@lo:400:kworker.0 00000100:00100000:0.0:1789579150.696809:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789579150.705929:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789579150.705966:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579150.706004:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277226624:0@lo:400:kworker.0 00000100:00100000:2.0:1789579150.708528:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579150.708700:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226624 00000100:00100000:2.0:1789579150.708712:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226624 00000100:00100000:2.0:1789579150.708770:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789579150.708781:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3616:x1876509277226624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579150.708844:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3616:x1876509277226624:12345-0@lo:400:kworker.0 Request processed in 66us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579150.708852:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789579150.708909:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277226624:0@lo:400:kworker.0 00000100:00100000:2.0:1789579150.708960:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226752 00000100:00100000:2.0:1789579150.708965:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226752 00000100:00100000:2.0:1789579150.708993:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789579150.709000:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277226752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579150.709057:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277226752:12345-0@lo:400:kworker.0 Request processed in 57us (12248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579150.709063:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789579150.709103:0:18626:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789579150.709111:0:18626:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789579150.710925:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226368 00000100:00100000:2.0:1789579150.710939:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226368 00000100:00080000:2.0:1789579150.711005:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579150.711114:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579150.711125:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277226496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579150.711154:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789579150.711238:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277226496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (18913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579150.711253:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789579150.711301:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789579150.711331:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277226496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579150.711397:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579150.711404:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277226368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789579150.711415:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789579150.711458:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277226368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (17584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579150.711478:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789579150.711544:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277226368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579150.717143:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277226880:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717215:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.717298:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579150.717306:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277227008:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717332:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.717383:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227008 00000100:00100000:1.0:1789579150.717389:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227008 00000100:00100000:1.0:1789579150.717432:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789579150.717441:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277227008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717491:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277227008:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.717498:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789579150.717539:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277227008:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717575:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277227136:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717600:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.717641:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227136 00000100:00100000:1.0:1789579150.717644:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227136 00000100:00100000:1.0:1789579150.717681:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789579150.717688:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277227136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717721:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277227136:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.717727:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789579150.717742:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579150.717762:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277227136:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717842:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579150.717849:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277227264:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.717910:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277226880 00000100:00100000:1.0:1789579150.717914:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277226880 00000100:00100000:1.0:1789579150.717938:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227264 00000100:00100000:1.0:1789579150.717941:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227264 00000100:00100000:1.0:1789579150.717958:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579150.717965:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277226880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.717997:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277226880:12345-0@lo:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718003:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789579150.718015:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579150.718021:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718046:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277227264:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718052:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789579150.718078:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277227264:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718088:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277226880:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718118:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277227392:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718139:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.718160:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227392 00000100:00100000:1.0:1789579150.718164:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227392 00000100:00100000:1.0:1789579150.718187:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789579150.718193:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277227392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718222:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277227392:12345-0@lo:400:kworker.0 Request processed in 30us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718238:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789579150.718253:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579150.718273:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277227392:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718298:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579150.718302:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277227520:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718324:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.718344:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227520 00000100:00100000:1.0:1789579150.718347:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227520 00000100:00100000:1.0:1789579150.718397:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789579150.718403:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277227520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718432:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277227520:12345-0@lo:400:kworker.0 Request processed in 30us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718437:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789579150.718449:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789579150.718466:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930486f800 x1876509277227520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579150.718477:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277227520:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718503:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277227648:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718525:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.718546:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227648 00000100:00100000:1.0:1789579150.718549:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227648 00000100:00100000:1.0:1789579150.718573:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789579150.718579:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718608:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876509277227648:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718635:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789579150.718649:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579150.718666:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876509277227648:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718694:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789579150.718699:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277227776:0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579150.718739:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227776 00000100:00100000:1.0:1789579150.718743:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227776 00000100:00100000:1.0:1789579150.718765:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789579150.718771:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579150.718855:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277227776:12345-0@lo:400:kworker.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579150.718861:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789579150.718874:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789579150.718889:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93930486f800 x1876509277227776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579150.718900:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277227776:0@lo:400:kworker.0 00000100:00100000:0.0:1789579150.740482:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277226240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579150.740544:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93930486d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277226752:0@lo:400:kworker.0 00000100:00100000:3.0:1789579150.742000:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277226240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49478us (50097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579150.742026:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789579151.267732:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579151.716313:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277227904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579151.716440:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579151.716846:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277227904 00000100:00100000:3.0:1789579151.716860:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277227904 00000100:00100000:3.0:1789579151.718253:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789579151.718283:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277227904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579151.718332:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579151.718457:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277227904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579151.718485:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579151.718606:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9394091fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277227904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579152.014713:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579152.014937:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261420928 00000100:00100000:1.0:1789579152.014947:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261420928 00000100:00100000:1.0:1789579152.015024:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789579152.015034:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:14965:x1876509261420928:12345-192.168.203.37@tcp:41:lfs.0 00000004:00000024:1.0:1789579152.015102:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579152.015311:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:14965:x1876509261420928:12345-192.168.203.37@tcp:41:lfs.0 Request processed in 277us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579152.015319:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00080000:2.0:1789579152.015977:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579152.019539:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.019715:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421056 00000100:00100000:2.0:1789579152.019729:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421056 00000100:00100000:2.0:1789579152.019844:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:2.0:1789579152.019857:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421056:12345-192.168.203.37@tcp:41:lfs.0 00000004:00000024:2.0:1789579152.019907:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789579152.020017:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421056:12345-192.168.203.37@tcp:41:lfs.0 Request processed in 162us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.020025:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00080000:1.0:1789579152.020479:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789579152.024498:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.024596:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421184 00000100:00100000:3.0:1789579152.024617:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421184 00000100:00100000:3.0:1789579152.024706:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789579152.024718:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421184:12345-192.168.203.37@tcp:13:lfs.0 00002000:00000024:3.0:1789579152.024753:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789579152.024921:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579152.024961:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421184:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 244us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.024971:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:0.0:1789579152.035235:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.035332:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421312 00000100:00100000:3.0:1789579152.035345:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421312 00000100:00100000:3.0:1789579152.035476:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579152.035487:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421312:12345-192.168.203.37@tcp:13:lfs.0 00002000:00000024:3.0:1789579152.035530:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789579152.035676:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:14965:x1876509261421312:12345-192.168.203.37@tcp:13:lfs.0 Request processed in 189us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.035685:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00080000:1.0:1789579152.035874:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789579152.241717:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.242028:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421440 00000100:00100000:3.0:1789579152.242042:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421440 00000100:00100000:3.0:1789579152.242120:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:3.0:1789579152.242132:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+10:14995:x1876509261421440:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789579152.242166:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579152.242190:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2ee00/0xd90373d592f22340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec327 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.242228:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2ee00/0xd90373d592f22340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec327 expref: 11 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.242259:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2ee00/0xd90373d592f22340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec327 expref: 11 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.242271:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ee00, rc 0) 00000100:00100000:3.0:1789579152.242561:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261421440:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 429us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.242570:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 132 00000100:00100000:3.0:1789579152.257870:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.258489:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421568 00000100:00100000:2.0:1789579152.258504:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421568 00000100:00100000:2.0:1789579152.258575:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:2.0:1789579152.258595:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261421568:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789579152.258843:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261421568:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 249us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.258851:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 133 00000100:00100000:0.0:1789579152.266058:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.266779:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421696 00000100:00100000:2.0:1789579152.266794:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421696 00000100:00100000:2.0:1789579152.266871:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:2.0:1789579152.266883:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261421696:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789579152.267078:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261421696:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 196us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.267088:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 134 00000100:00100000:0.0:1789579152.282732:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.283173:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421824 00000100:00100000:3.0:1789579152.283187:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421824 00000100:00100000:3.0:1789579152.283258:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 135 00000100:00100000:3.0:1789579152.283270:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261421824:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789579152.283530:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261421824:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 262us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.283540:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 135 00010000:00010000:2.0:1789579152.291909:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579152.324718:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.324886:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261421952 00000100:00100000:3.0:1789579152.324899:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261421952 00000100:00100000:3.0:1789579152.324969:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:3.0:1789579152.324981:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261421952:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789579152.325181:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394129e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261421952:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 202us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.325191:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 136 00000100:00100000:0.0:1789579152.342938:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.344711:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422080 00000100:00100000:2.0:1789579152.344732:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422080 00000100:00100000:2.0:1789579152.344830:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:2.0:1789579152.344843:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261422080:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579152.345082:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:15004:x1876509261422080:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 239us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.345091:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 137 00000100:00100000:2.0:1789579152.348950:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.349149:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422208 00000100:00100000:0.0:1789579152.349162:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422208 00000100:00100000:0.0:1789579152.349229:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:0.0:1789579152.349240:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14995:x1876509261422208:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789579152.349262:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579152.349284:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437e00/0xd90373d592f22347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec358 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579152.349843:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437e00/0xd90373d592f22347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec358 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579152.349860:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437e00/0xd90373d592f22347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec358 expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579152.349872:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437e00, rc 0) 00000100:00100000:0.0:1789579152.349951:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14995:x1876509261422208:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 713us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.349960:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 138 00000100:00100000:0.0:1789579152.356302:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.361777:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422336 00000100:00100000:3.0:1789579152.361799:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422336 00000100:00100000:3.0:1789579152.362148:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:3.0:1789579152.362182:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14995:x1876509261422336:12345-192.168.203.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789579152.362222:0:17113:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789579152.362243:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789579152.362248:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789579152.362252:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789579152.362255:0:17113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789579152.362258:0:17113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789579152.370612:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14995:x1876509261422336:12345-192.168.203.37@tcp:256:mount.lustre.0 Request processed in 8401us (14294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.370633:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 139 00000100:00100000:0.0:1789579152.375906:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.376828:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422464 00000100:00100000:3.0:1789579152.376843:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422464 00000100:00100000:3.0:1789579152.376923:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:3.0:1789579152.376936:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14995:x1876509261422464:12345-192.168.203.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789579152.376958:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579152.376981:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec35f expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.377016:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.377031:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.377043:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f400, rc 0) 00000100:00100000:3.0:1789579152.377122:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14995:x1876509261422464:12345-192.168.203.37@tcp:101:mount.lustre.0 Request processed in 188us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.377130:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 140 00000100:00100000:0.0:1789579152.385454:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.385836:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422592 00000100:00100000:3.0:1789579152.385850:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422592 00000100:00100000:3.0:1789579152.385925:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:3.0:1789579152.385938:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14995:x1876509261422592:12345-192.168.203.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789579152.386153:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14995:x1876509261422592:12345-192.168.203.37@tcp:501:mount.lustre.0 Request processed in 217us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.386162:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 141 00000100:00100000:0.0:1789579152.389639:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.389770:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422720 00000100:00100000:2.0:1789579152.389784:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422720 00000100:00100000:2.0:1789579152.389857:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:2.0:1789579152.389869:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14995:x1876509261422720:12345-192.168.203.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789579152.390084:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14995:x1876509261422720:12345-192.168.203.37@tcp:503:mount.lustre.0 Request processed in 216us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.390104:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 142 00000100:00100000:2.0:1789579152.395264:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.395705:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422848 00000100:00100000:0.0:1789579152.395723:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422848 00000100:00100000:0.0:1789579152.395812:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 143 00000100:00100000:0.0:1789579152.395825:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:15009:x1876509261422848:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789579152.396072:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:15009:x1876509261422848:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 248us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.396081:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 143 00000100:00100000:0.0:1789579152.417863:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.418067:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261422976 00000100:00100000:2.0:1789579152.418082:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261422976 00000100:00100000:2.0:1789579152.418155:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:2.0:1789579152.418168:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:15009:x1876509261422976:12345-192.168.203.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789579152.418449:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:15009:x1876509261422976:12345-192.168.203.37@tcp:502:llog_process_th.0 Request processed in 281us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.418457:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 144 00000100:00100000:1.0:1789579152.436141:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579152.436247:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579152.436292:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.436388:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423616 00000100:00100000:0.0:1789579152.436401:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423616 00000100:00100000:0.0:1789579152.436480:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579152.436493:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423616:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579152.436619:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423616:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.436628:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:1.0:1789579152.446643:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579152.446787:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.446822:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423744 00000100:00100000:0.0:1789579152.446844:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423744 00000100:00100000:0.0:1789579152.446928:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789579152.446940:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423744:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579152.447056:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423744:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 117us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.447064:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:2.0:1789579152.448194:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423360 00000100:00100000:2.0:1789579152.448207:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423360 00000100:00100000:2.0:1789579152.448269:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423488 00000100:00100000:2.0:1789579152.448273:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423488 00000100:00100000:2.0:1789579152.448316:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789579152.448325:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2392:x1876509261423360:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579152.448389:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:0.0:1789579152.448397:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423488:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579152.448408:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2392:x1876509261423360:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 85us (12282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.448416:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:0.0:1789579152.448424:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2392:x1876509261423488:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 29us (12132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.448429:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789579152.452435:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423104 00000100:00100000:2.0:1789579152.452455:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423104 00000100:00100000:2.0:1789579152.452512:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:2.0:1789579152.452522:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1876509261423104:12345-192.168.203.37@tcp:38:mount.lustre.0 00000100:00100000:1.0:1789579152.452683:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.452816:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423872 00000100:00100000:0.0:1789579152.452822:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423872 00000100:00100000:0.0:1789579152.452993:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579152.453000:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2391:x1876509261423872:12345-192.168.203.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789579152.453324:0:17118:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c@192.168.203.37@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1789579152.453408:0:17118:0:(genops.c:1384:class_connect()) connect: client 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c, cookie 0xd90373d592f22355 00000004:00100000:0.0:1789579152.453442:0:17118:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00010000:00080000:2.0:1789579152.454494:0:17119:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c@192.168.203.37@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1789579152.454693:0:17119:0:(genops.c:1384:class_connect()) connect: client 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c, cookie 0xd90373d592f2235c 00000004:00100000:2.0:1789579152.454723:0:17119:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789579152.455489:0:17119:0:(import.c:65:import_set_state_nolock()) ffff939403952000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789579152.457254:0:17118:0:(import.c:65:import_set_state_nolock()) ffff939436de8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579152.457649:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2391:x1876509261423104:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 5117us (10851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.457664:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789579152.459113:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2391:x1876509261423872:12345-192.168.203.37@tcp:38:mount.lustre.0 Request processed in 6100us (6420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.460503:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789579152.468796:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.469398:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.469506:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.471390:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424128 00000100:00100000:3.0:1789579152.471411:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424128 00000100:00080000:2.0:1789579152.471985:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579152.479081:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424000 00000100:00100000:1.0:1789579152.479105:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424000 00000100:00100000:1.0:1789579152.479221:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261423232 00000100:00100000:1.0:1789579152.479226:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261423232 00000100:00100000:1.0:1789579152.479252:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:1.0:1789579152.479263:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+7:14995:x1876509261424128:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789579152.479306:0:18390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579152.479429:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+7:14995:x1876509261424128:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 167us (10645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579152.479438:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:1.0:1789579152.479461:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579152.479467:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:0:x1876509261424000:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789579152.479481:0:18390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579152.479530:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:0:x1876509261424000:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 63us (10134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579152.479549:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:1.0:1789579152.479564:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:1.0:1789579152.479570:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:0:x1876509261423232:12345-192.168.203.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789579152.479599:0:18390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579152.479636:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:0:x1876509261423232:12345-192.168.203.37@tcp:41:mount.lustre.0 Request processed in 66us (10129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579152.479642:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00080000:2.0:1789579152.480112:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579152.490098:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.491860:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424256 00000100:00100000:3.0:1789579152.491880:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424256 00000100:00100000:3.0:1789579152.491984:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789579152.491996:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424256:12345-192.168.203.37@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789579152.492418:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424256:12345-192.168.203.37@tcp:40:mount.lustre.0 Request processed in 141us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.492428:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:1.0:1789579152.499902:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579152.499977:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579152.500758:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424384 00000100:00100000:2.0:1789579152.500773:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424384 00000100:00100000:2.0:1789579152.500840:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424512 00000100:00100000:2.0:1789579152.500844:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424512 00000100:00100000:2.0:1789579152.500878:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789579152.500891:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876509261424384:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789579152.500937:0:18623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c@192.168.203.37@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1789579152.500990:0:18623:0:(genops.c:1384:class_connect()) connect: client 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c, cookie 0xd90373d592f22363 00002000:00100000:2.0:1789579152.501005:0:18623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c/ffff939403951800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789579152.501027:0:18623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789579152.501131:0:18623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789579152.501169:0:18623:0:(import.c:65:import_set_state_nolock()) ffff939403951000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579152.501256:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2391:x1876509261424384:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 366us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.501264:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789579152.501282:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789579152.501287:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876509261424512:12345-192.168.203.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789579152.501323:0:18623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c@192.168.203.37@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1789579152.501391:0:18623:0:(genops.c:1384:class_connect()) connect: client 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c, cookie 0xd90373d592f2236a 00002000:00100000:2.0:1789579152.501396:0:18623:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c/ffff939436c51800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789579152.501403:0:18623:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789579152.501446:0:18623:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789579152.501460:0:18623:0:(import.c:65:import_set_state_nolock()) ffff939436c54000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789579152.501484:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2391:x1876509261424512:12345-192.168.203.37@tcp:8:mount.lustre.0 Request processed in 194us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579152.501490:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789579152.503628:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.504951:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424640 00000100:00100000:3.0:1789579152.504980:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424640 00000100:00100000:3.0:1789579152.505080:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:3.0:1789579152.505093:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424640:12345-192.168.203.37@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789579152.505731:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424640:12345-192.168.203.37@tcp:900:mount.lustre.0 Request processed in 636us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.505742:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:2.0:1789579152.511928:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579152.512224:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424768 00000100:00100000:0.0:1789579152.512240:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424768 00000100:00100000:0.0:1789579152.512392:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789579152.512407:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424768:12345-192.168.203.37@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789579152.512533:0:17121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789579152.512656:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:14995:x1876509261424768:12345-192.168.203.37@tcp:33:mount.lustre.0 Request processed in 251us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579152.512665:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:2.0:1789579152.762613:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579152.764431:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261424896 00000100:00100000:3.0:1789579152.764450:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261424896 00000100:00100000:3.0:1789579152.764615:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789579152.764630:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:15032:x1876509261424896:12345-192.168.203.37@tcp:101:mkdir.0 00010000:00010000:3.0:1789579152.764680:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579152.764712:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fc00/0xd90373d592f22371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec390 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.764800:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.764818:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.764853:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579152.764918:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789579152.764922:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789579152.764957:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.764988:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fc00/0xd90373d592f22371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 8 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.765022:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 7 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579152.765031:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:3.0:1789579152.765035:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789579152.765039:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e400, rc 0) 00000100:00100000:3.0:1789579152.765124:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+7:15032:x1876509261424896:12345-192.168.203.37@tcp:101:mkdir.0 Request processed in 498us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579152.765131:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789579153.254400:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579153.254503:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579153.254707:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228032 00000100:00100000:3.0:1789579153.254718:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228032 00000100:00100000:3.0:1789579153.254791:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789579153.254796:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277228160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579153.254802:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228032:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579153.254829:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579153.254864:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228160 00000100:00100000:1.0:1789579153.254869:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228160 00000100:00100000:1.0:1789579153.254892:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789579153.254899:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277228160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789579153.254928:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789579153.254980:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277228160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579153.254987:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789579153.255052:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277228160:0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789579153.255151:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579153.255202:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 402us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579153.255208:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789579153.255288:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228032:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789579153.315621:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579154.342246:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789579154.790027:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:0.0:1789579154.790037:0:17098:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000001:00100000:2.0:1789579154.790437:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:2.0:1789579154.790443:0:18619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000001:00100000:1.0:1789579154.791035:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:1.0:1789579154.791041:0:17849:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00000001:00100000:0.0:1789579154.791260:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c259fca-ec9a-4b20-b3ac-ca463a9ba85c 00000001:00100000:0.0:1789579154.791276:0:19437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb59b6f8-2a36-456b-b988-f5328ecc7957 00010000:00010000:2.0:1789579155.365507:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789579155.782003:0:19996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789579155.811781:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.811846:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.811895:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277228928:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.811917:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.811935:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277229440:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.811958:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.811980:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789579155.811986:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277228288:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812012:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812034:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277228800:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812054:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812071:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277229312:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812091:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812120:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277229824:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812146:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812171:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228544:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812194:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812221:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277229056:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812240:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812259:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277229568:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812280:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812292:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789579155.812297:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228672:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812316:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812333:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277229184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812374:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812392:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277229696:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812415:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579155.812442:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228416 00000100:00100000:3.0:1789579155.812449:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228416 00000100:00100000:3.0:1789579155.812487:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228928 00000100:00100000:3.0:1789579155.812490:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228928 00000100:00100000:3.0:1789579155.812505:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789579155.812514:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277228416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812566:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277228416:12345-0@lo:400:kworker.0 Request processed in 52us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812572:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789579155.812601:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579155.812608:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277228928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812635:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277228928:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812640:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789579155.812661:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228288 00000100:00100000:3.0:1789579155.812670:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228288 00000100:00100000:3.0:1789579155.812692:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789579155.812698:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3618:x1876509277228288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812727:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3618:x1876509277228288:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812732:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789579155.812758:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229440 00000100:00100000:3.0:1789579155.812761:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229440 00000100:00100000:3.0:1789579155.812786:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228800 00000100:00100000:3.0:1789579155.812789:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228800 00000100:00100000:3.0:1789579155.812798:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229312 00000100:00100000:3.0:1789579155.812800:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229312 00000100:00100000:3.0:1789579155.812810:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229824 00000100:00100000:3.0:1789579155.812812:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229824 00000100:00100000:3.0:1789579155.812823:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229568 00000100:00100000:3.0:1789579155.812826:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229568 00000100:00100000:3.0:1789579155.812837:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229696 00000100:00100000:3.0:1789579155.812839:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229696 00000100:00100000:3.0:1789579155.812852:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789579155.812857:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277229440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812885:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1876509277229440:12345-0@lo:400:kworker.0 Request processed in 28us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812891:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789579155.812901:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579155.812906:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277228800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812930:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277228800:12345-0@lo:400:kworker.0 Request processed in 24us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812935:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789579155.812946:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579155.812957:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277229312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.812984:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277229312:12345-0@lo:400:kworker.0 Request processed in 28us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.812990:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789579155.813001:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789579155.813007:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277229824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813032:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277229824:12345-0@lo:400:kworker.0 Request processed in 25us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813038:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789579155.813048:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789579155.813054:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277229568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813084:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876509277229568:12345-0@lo:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813091:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789579155.813102:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789579155.813107:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277229696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813132:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277229696:12345-0@lo:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813137:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789579155.813162:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228544 00000100:00100000:3.0:1789579155.813165:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228544 00000100:00100000:3.0:1789579155.813188:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229056 00000100:00100000:3.0:1789579155.813192:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229056 00000100:00100000:3.0:1789579155.813203:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277228672 00000100:00100000:3.0:1789579155.813205:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277228672 00000100:00100000:3.0:1789579155.813215:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229184 00000100:00100000:3.0:1789579155.813217:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229184 00000100:00100000:3.0:1789579155.813236:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579155.813241:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813272:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228544:12345-0@lo:400:kworker.0 Request processed in 30us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813277:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789579155.813288:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789579155.813294:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277229056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813318:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277229056:12345-0@lo:400:kworker.0 Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813323:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789579155.813333:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579155.813339:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813391:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277228672:12345-0@lo:400:kworker.0 Request processed in 52us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813396:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789579155.813406:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579155.813412:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277229184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813451:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277229184:12345-0@lo:400:kworker.0 Request processed in 39us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579155.813457:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789579155.813505:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228672:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813515:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277229184:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813523:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277229696:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813530:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277228544:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813547:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277229056:0@lo:400:kworker.0 00010000:00080000:3.0:1789579155.813558:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304811f80 x1876509277229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579155.813568:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876509277229568:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813615:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277228288:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813625:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277228800:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813634:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277229312:0@lo:400:kworker.0 00010000:00080000:3.0:1789579155.813643:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304813800 x1876509277229824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579155.813651:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277229824:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813660:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813669:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277228928:0@lo:400:kworker.0 00000100:00100000:3.0:1789579155.813676:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876509277229440:0@lo:400:kworker.0 00000100:00080000:2.0:1789579155.813929:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789579155.813934:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789579155.813937:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789579155.813939:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579155.813975:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789579155.813985:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277229952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579155.814028:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579155.814057:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277229952 00000100:00100000:2.0:1789579155.814061:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277229952 00000100:00100000:2.0:1789579155.814088:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789579155.814095:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277229952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789579155.814126:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789579155.814160:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277229952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579155.814166:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789579155.814199:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277229952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579155.814345:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789579155.814383:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579155.814411:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579155.814442:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230080 00000100:00100000:1.0:1789579155.814447:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230080 00000100:00100000:1.0:1789579155.814469:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789579155.814475:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277230080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789579155.814485:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789579155.814513:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277230080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579155.814519:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789579155.814544:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789579155.822275:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579155.822295:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277230208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579155.822368:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579155.822407:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230208 00000100:00100000:1.0:1789579155.822413:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230208 00000100:00100000:1.0:1789579155.822450:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579155.822457:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277230208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789579155.822482:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579155.822519:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277230208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579155.822525:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789579155.822564:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277230208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789579156.391345:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579156.835985:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789579156.836008:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277230336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579156.836074:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579156.836702:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230336 00000100:00100000:1.0:1789579156.836711:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230336 00000100:00100000:1.0:1789579156.836764:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789579156.836774:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277230336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789579156.836810:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579156.836872:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277230336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579156.836879:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789579156.837946:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277230336:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579157.411661:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579157.622132:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622173:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622193:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622210:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622250:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622270:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622286:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622302:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622325:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579157.622375:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425408 00000100:00100000:3.0:1789579157.622385:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425408 00000100:00100000:3.0:1789579157.622436:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425920 00000100:00100000:3.0:1789579157.622439:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425920 00000100:00100000:3.0:1789579157.622452:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425536 00000100:00100000:3.0:1789579157.622454:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425536 00000100:00100000:3.0:1789579157.622465:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426048 00000100:00100000:3.0:1789579157.622467:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426048 00000100:00100000:3.0:1789579157.622481:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789579157.622491:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425408:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.622554:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425408:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 64us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.622561:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:3.0:1789579157.622588:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579157.622594:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261425920:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.622617:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261425920:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.622622:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579157.622633:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789579157.622639:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425536:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.622660:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425536:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.622672:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789579157.622684:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789579157.622690:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261426048:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.622713:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261426048:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.622718:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:3.0:1789579157.622733:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425152 00000100:00100000:3.0:1789579157.622736:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425152 00000100:00100000:2.0:1789579157.622993:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425664 00000100:00100000:2.0:1789579157.622998:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425664 00000100:00100000:3.0:1789579157.623038:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425280 00000100:00100000:3.0:1789579157.623042:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425280 00000100:00100000:1.0:1789579157.625706:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425792 00000100:00100000:1.0:1789579157.625736:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425792 00000100:00100000:2.0:1789579157.628093:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789579157.628182:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2394:x1876509261425152:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579157.628262:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2394:x1876509261425152:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 93us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579157.628269:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789579157.628289:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:2.0:1789579157.628297:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2394:x1876509261425664:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:2.0:1789579157.628322:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2394:x1876509261425664:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 26us (6128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579157.628328:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00080000:2.0:1789579157.630519:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789579157.630530:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789579157.630533:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789579157.630554:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579157.632267:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:3.0:1789579157.632289:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425280:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.632389:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393048edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2394:x1876509261425280:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 111us (10117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.632397:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:1.0:1789579157.642933:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789579157.642946:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261425024 00000100:00100000:3.0:1789579157.642961:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261425024 00000100:00100000:1.0:1789579157.642966:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261425792:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579157.643030:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 146 00000100:00100000:3.0:1789579157.643042:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261425024:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579157.643092:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2394:x1876509261425792:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 144us (20785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579157.643103:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:3.0:1789579157.643113:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261425024:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 70us (20858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579157.643122:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 146 00000040:00080000:3.0:1789579157.800215:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789579158.372146:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277230464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789579158.372249:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579158.372287:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277230592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579158.372320:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579158.372333:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230464 00000100:00100000:0.0:1789579158.372382:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230464 00000100:00100000:1.0:1789579158.372387:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230592 00000100:00100000:1.0:1789579158.372391:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230592 00000100:00100000:0.0:1789579158.372457:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789579158.372469:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277230464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579158.372524:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789579158.372589:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277230464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579158.372616:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789579158.378777:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277230464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789579158.383390:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789579158.383416:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277230592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579158.383477:0:17124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579158.383606:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277230592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (11284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579158.383614:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789579158.388642:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277230592:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789579158.436334:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579159.208653:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789579159.460409:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789579160.387249:0:20144:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1ad5e890 20000000:00000080:0.0:1789579160.387275:0:20144:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939435dc9c00 uarg=0000000000000000 20000000:01000000:0.0:1789579160.387343:0:20144:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789579160.387384:0:20144:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789579160.387391:0:20144:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789579160.388686:0:20145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789579160.388979:0:20144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789579160.396823:0:20144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789579160.396887:0:20144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396912:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2200d expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396921:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396929:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f2205a expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396936:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396947:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396954:0:20144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.396963:0:20144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.397039:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.397060:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 12 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.397079:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230720:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579160.397241:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.397250:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 12 pid: 17112 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.398084:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230848:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579160.398181:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.398192:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.398203:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230976:0@lo:104: 00000100:00100000:3.0:1789579160.398250:0:20144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579160.400615:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277230976 00000100:00100000:2.0:1789579160.400633:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277230976 00010000:00010000:3.0:1789579160.400672:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.400691:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 23 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.400791:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231104:0@lo:104: 00000100:00100000:2.0:1789579160.400839:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579160.400852:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277230976:12345-0@lo:104: 00000100:00100000:3.0:1789579160.400861:0:20144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579160.400869:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.400900:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.400911:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.400922:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231232:0@lo:104: 00010000:00010000:2.0:1789579160.400940:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789579160.400949:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277230976:12345-0@lo:104: Request processed in 99us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.400957:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789579160.400977:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231104 00000100:00100000:2.0:1789579160.400980:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231104 00000100:00100000:2.0:1789579160.400994:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789579160.400999:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277231104:12345-0@lo:104: 00010000:00010000:2.0:1789579160.401006:0:17101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401143:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579160.401152:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401168:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579160.401174:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401184:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579160.401192:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.401196:0:17101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1789579160.401200:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789579160.401205:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277231104:12345-0@lo:104: Request processed in 204us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.401214:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789579160.401246:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401254:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579160.401291:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401299:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff939303437c00/0xd90373d592f220f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f220fb expref: -99 pid: 19436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401314:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789579160.401318:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401324:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394421c6600 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:1.0:1789579160.401327:0:17107:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401345:0:17107:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789579160.401385:0:17107:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789579160.401391:0:17107:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789579160.401406:0:17107:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401412:0:17107:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789579160.401430:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401437:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394421c6600/0xd90373d592f2205a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22061 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.401448:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579160.401450:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789579160.401451:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579160.401472:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789579160.401486:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277231360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579160.401524:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579160.401570:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277231488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579160.401593:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789579160.401821:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579160.402190:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231360 00000100:00100000:1.0:1789579160.402199:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231360 00010000:00010000:1.0:1789579160.402233:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 24 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.402294:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231488 00000100:00100000:1.0:1789579160.402298:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231488 00010000:00010000:1.0:1789579160.402312:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 25 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.402326:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789579160.402333:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+25:3615:x1876509277231360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579160.402347:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579160.402377:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 25 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.402388:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 25 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.402408:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579160.402446:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+25:3615:x1876509277231360:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579160.402453:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789579160.402474:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579160.402479:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3617:x1876509277231488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579160.402487:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579160.402491:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 24 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.402498:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 24 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.402508:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579160.402540:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3617:x1876509277231488:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579160.402558:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789579160.402609:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277231360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579160.402636:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277231488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789579160.403308:0:20144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789579160.403441:0:20144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.403454:0:20144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.403468:0:20144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231616:0@lo:104: 00000100:00100000:3.0:1789579160.403503:0:20144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579160.403626:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579160.403730:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579160.403759:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426304 00000100:00100000:1.0:1789579160.403766:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426304 00010000:00010000:1.0:1789579160.403795:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 13 pid: 17112 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.403824:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426176 00000100:00100000:1.0:1789579160.403827:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426176 00010000:00010000:1.0:1789579160.403841:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 14 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.403854:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:1.0:1789579160.403863:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+14:2395:x1876509261426304:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579160.403874:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579160.403880:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 14 pid: 17112 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.403889:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 14 pid: 17112 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.403907:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579160.404097:0:17104:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789579160.404112:0:17104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789579160.404162:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231232 00000100:00100000:0.0:1789579160.404168:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231232 00000100:00100000:3.0:1789579160.404189:0:20144:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579160.404193:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231616 00000100:00100000:0.0:1789579160.404195:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231616 00000100:00100000:0.0:1789579160.404209:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789579160.404214:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230720:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579160.404217:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:20144:x1876509277231232:12345-0@lo:104: 00010000:00010000:3.0:1789579160.404226:0:20144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436800/0xd90373d592f2230f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec2ef expref: 14 pid: 17112 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404232:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.404246:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230848:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579160.404271:0:20144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c7600/0xd90373d592f220fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f220f4 expref: 23 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579160.404282:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579160.404283:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277230976:0@lo:104: 00010000:00010000:0.0:1789579160.404289:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789579160.404294:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+4:20144:x1876509277231232:12345-0@lo:104: Request processed in 79us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579160.404305:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789579160.404310:0:20144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394363afa00/0xd90373d592f22061 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2205a expref: 22 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579160.404311:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2394:x1876509261426176:12345-192.168.203.37@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789579160.404324:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789579160.404326:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231104:0@lo:104: 00010000:00010000:2.0:1789579160.404327:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789579160.404333:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277231616:12345-0@lo:104: 00010000:00010000:2.0:1789579160.404336:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 13 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.404337:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231232:0@lo:104: 00010000:00010000:0.0:1789579160.404344:0:17102:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.404398:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 13 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404403:0:17102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789579160.404411:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2f400/0xd90373d592f2234e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec35f expref: 13 pid: 17111 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579160.404419:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:044b3bf9-43fa-4501-b924-7b81ca047525+3:20144:x1876509277231616:12345-0@lo:104: Request processed in 86us (913us total) trans 0 rc 0/0 00010000:00010000:2.0:1789579160.404426:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579160.404429:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789579160.404454:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789579160.404455:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:2394:x1876509261426176:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 148us (724us total) trans 0 rc 0/0 00010000:00010000:0.0:1789579160.404463:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579160.404466:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00010000:00010000:0.0:1789579160.404477:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579160.404482:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404493:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579160.404501:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579160.404507:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789579160.404541:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404562:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579160.404584:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404592:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363af800/0xd90373d592f2201b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22022 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404605:0:17106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789579160.404609:0:17106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404626:0:17106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc125cc20) 10000000:00010000:0.0:1789579160.404629:0:17106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404635:0:17106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789579160.404641:0:17106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579160.404647:0:17106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789579160.404662:0:17106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404669:0:17106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789579160.404693:0:17106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404700:0:17106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.137@tcp lock: ffff9394363ae000/0xd90373d592f2200d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd90373d592f22014 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579160.404714:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579160.404716:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579160.404717:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579160.404802:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277231744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579160.404841:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.405037:0:20144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20144:1876509277231616:0@lo:104: 00010000:00010000:3.0:1789579160.405075:0:20144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579160.405127:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789579160.405140:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277231872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789579160.405177:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579160.405282:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231744 00000100:00100000:2.0:1789579160.405288:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231744 00010000:00010000:2.0:1789579160.405309:0:20146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 22 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.405320:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:2395:x1876509261426304:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 1451us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.405328:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277231872 00000100:00100000:2.0:1789579160.405332:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277231872 00000100:00100000:1.0:1789579160.405342:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00010000:00010000:2.0:1789579160.405346:0:20146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579160.405381:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789579160.405390:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+23:3618:x1876509277231744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579160.405400:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579160.405405:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.405416:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.405428:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939303436200/0xd90373d592f22022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2201b expref: 23 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579160.405440:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579160.405482:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:044b3bf9-43fa-4501-b924-7b81ca047525+22:3618:x1876509277231744:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.405490:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789579160.405499:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+22:3616:x1876509277231872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789579160.405503:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789579160.405512:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579160.405518:0:20146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 21 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405536:0:20146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 21 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405556:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9394421c6000/0xd90373d592f22014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd90373d592f2200d expref: 21 pid: 17113 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405571:0:20146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405580:0:20146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405596:0:20146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405604:0:20146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405610:0:20146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405617:0:20146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405623:0:20146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fc00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:2.0:1789579160.405628:0:20146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.405636:0:20146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579160.405663:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277231744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789579160.405772:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789579160.407038:0:20146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579160.407065:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789579160.407195:0:20144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.407206:0:20144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579160.407214:0:20144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939302b2fc00/0xd90373d592f2237f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579160.407397:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:044b3bf9-43fa-4501-b924-7b81ca047525+20:3616:x1876509277231872:12345-0@lo:103:ldlm_bl.0 Request processed in 1897us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.407408:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789579160.407533:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9393043a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:044b3bf9-43fa-4501-b924-7b81ca047525:3616:1876509277231872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789579160.485560:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579160.944898:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277232000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579160.945065:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579160.945762:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232000 00000100:00100000:0.0:1789579160.945775:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232000 00000100:00100000:0.0:1789579160.945849:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789579160.945862:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277232000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789579160.945901:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1789579160.946730:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789579160.946752:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277232128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789579160.946797:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579160.946845:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232128 00000100:00100000:2.0:1789579160.946850:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232128 00000100:00100000:2.0:1789579160.946886:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789579160.946895:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277232128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789579160.946919:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579160.946971:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277232128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.946979:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789579160.946999:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579160.947036:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277232128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789579160.953946:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277232256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579160.954038:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.954228:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232256 00000100:00100000:3.0:1789579160.954239:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232256 00000100:00100000:3.0:1789579160.954310:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579160.954321:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277232256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789579160.954449:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789579160.954508:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277232256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 187us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.954515:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789579160.954540:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579160.954598:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277232256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789579160.955387:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277232000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9525us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579160.955398:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789579160.955439:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277232384:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955487:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.955524:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277232896:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955583:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.955706:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277233408:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955737:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.955761:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789579160.955767:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277232512:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955791:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.955807:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277233024:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955826:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.955842:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277233536:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955863:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579160.955887:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232384 00000100:00100000:3.0:1789579160.955889:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232896 00000100:00100000:3.0:1789579160.955895:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232896 00000100:00100000:2.0:1789579160.955895:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232384 00000100:00100000:3.0:1789579160.955936:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789579160.955944:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277232896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579160.955946:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789579160.955952:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+20:3615:x1876509277232384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.955987:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277232896:12345-0@lo:400:kworker.0 Request processed in 43us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579160.955987:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+20:3615:x1876509277232384:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.955994:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789579160.956003:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789579160.956012:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233408 00000100:00100000:3.0:1789579160.956016:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233408 00000100:00100000:2.0:1789579160.956032:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277232768:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956039:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233024 00000100:00100000:3.0:1789579160.956041:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233024 00000100:00100000:3.0:1789579160.956052:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233536 00000100:00100000:3.0:1789579160.956055:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233536 00000100:00100000:2.0:1789579160.956056:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.956070:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789579160.956073:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277233280:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956076:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277233408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579160.956092:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.956716:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277233408:12345-0@lo:400:kworker.0 Request processed in 637us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956734:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789579160.956750:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233280 00000100:00100000:3.0:1789579160.956754:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233280 00000100:00100000:3.0:1789579160.956768:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579160.956771:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277233024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956801:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277233024:12345-0@lo:400:kworker.0 Request processed in 30us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956805:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579160.956812:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789579160.956815:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277233536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956829:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277233536:12345-0@lo:400:kworker.0 Request processed in 14us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956832:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789579160.956837:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789579160.956841:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277233280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956867:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876509277233280:12345-0@lo:400:kworker.0 Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956870:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789579160.956888:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232512 00000100:00100000:3.0:1789579160.956890:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232512 00000100:00100000:3.0:1789579160.956906:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232768 00000100:00100000:3.0:1789579160.956908:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232768 00000100:00100000:3.0:1789579160.956914:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579160.956926:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277232512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956949:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277232512:12345-0@lo:400:kworker.0 Request processed in 31us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956959:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789579160.956968:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789579160.956972:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277232768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.956989:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277232768:12345-0@lo:400:kworker.0 Request processed in 18us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.956993:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789579160.957006:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789579160.957009:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789579160.957011:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579160.957039:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277232512:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957047:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277233024:0@lo:400:kworker.0 00010000:00080000:3.0:1789579160.957056:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939408eaea00 x1876509277233536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579160.957064:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277233536:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957070:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:044b3bf9-43fa-4501-b924-7b81ca047525:3615:1876509277232384:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957077:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277232896:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957082:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277233408:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957119:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277232640:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.957137:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.957150:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277233152:0@lo:400:kworker.0 00000100:00100000:1.0:1789579160.958207:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277232000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579160.958261:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277232640 00000100:00100000:1.0:1789579160.958269:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277232640 00000100:00100000:1.0:1789579160.958317:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789579160.958324:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277232640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579160.958401:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1876509277232640:12345-0@lo:400:kworker.0 Request processed in 77us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579160.958417:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789579160.960085:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579160.960239:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876509277232640:0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.960293:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233152 00000100:00100000:3.0:1789579160.960301:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233152 00000100:00100000:3.0:1789579160.960372:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579160.960382:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277233152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579160.960442:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277233152:12345-0@lo:400:kworker.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579160.960449:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789579160.960470:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789579160.960642:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277233152:0@lo:400:kworker.0 00010000:00080000:2.0:1789579160.966730:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939408eaed80 x1876509277233280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579160.966754:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876509277233280:0@lo:400:kworker.0 00000100:00100000:2.0:1789579160.966802:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277232768:0@lo:400:kworker.0 00010000:00010000:0.0:1789579161.511521:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579161.653255:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579161.654278:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426432 00000100:00100000:1.0:1789579161.654294:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426432 00000100:00100000:1.0:1789579161.654395:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:1.0:1789579161.654407:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+11:14878:x1876509261426432:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579161.654442:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579161.654469:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939401519200/0xd90373d592f22386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec397 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.654508:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939401519200/0xd90373d592f22386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec397 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.654523:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939401519200/0xd90373d592f22386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec397 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.654533:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519200, rc 0) 00000100:00100000:1.0:1789579161.654625:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426432:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 220us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579161.654632:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 148 00000100:00100000:1.0:1789579161.674215:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579161.674289:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426560 00000100:00100000:3.0:1789579161.674304:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426560 00000100:00100000:3.0:1789579161.674396:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:3.0:1789579161.674410:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426560:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.674649:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426560:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 240us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.674658:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 149 00000100:00100000:2.0:1789579161.681035:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579161.681696:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426688 00000100:00100000:3.0:1789579161.681710:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426688 00000100:00100000:3.0:1789579161.681786:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:3.0:1789579161.681800:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426688:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.682012:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93942e73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426688:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 214us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.682031:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 150 00000100:00100000:1.0:1789579161.694431:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579161.695796:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426816 00000100:00100000:0.0:1789579161.695817:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426816 00000100:00100000:0.0:1789579161.695948:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 151 00000100:00100000:0.0:1789579161.695960:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+12:14878:x1876509261426816:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579161.696078:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579161.696105:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303437a00/0xd90373d592f2238d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec39e expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.696143:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303437a00/0xd90373d592f2238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec39e expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.696157:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303437a00/0xd90373d592f2238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec39e expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.696168:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303437a00, rc 0) 00000100:00100000:0.0:1789579161.696256:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14878:x1876509261426816:12345-192.168.203.37@tcp:101:ll_cfg_requeue.0 Request processed in 297us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579161.696263:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 151 10000000:01000000:1.0:1789579161.699837:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789579161.699849:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93930377d800 from 13 10000000:01000000:1.0:1789579161.699855:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789579161.699929:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.699942:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.699974:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579161.700005:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.700517:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579161.715797:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233664 00000100:00100000:2.0:1789579161.715824:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233664 00000100:00100000:1.0:1789579161.715864:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408fb1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789579161.715987:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579161.716511:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261426944 00000100:00100000:1.0:1789579161.716519:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261426944 00000100:00100000:1.0:1789579161.716588:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00100000:1.0:1789579161.716599:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14878:x1876509261426944:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.716790:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14878:x1876509261426944:12345-192.168.203.37@tcp:501:ll_cfg_requeue.0 Request processed in 192us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579161.716799:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 152 00000100:00100000:3.0:1789579161.723684:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789579161.723807:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+20:17115:x1876509277233664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579161.723840:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579161.723869:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2fc00/0xd90373d592f2239b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f22394 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.723923:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2fc00/0xd90373d592f2239b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f22394 expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.723936:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2fc00/0xd90373d592f2239b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f22394 expref: 21 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.723946:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2fc00, rc 0) 00000100:00100000:3.0:1789579161.724059:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277233664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (23542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.724067:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789579161.725588:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579161.725625:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.725638:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579161.725752:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.725813:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579161.725871:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408fb1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789579161.728172:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579161.728229:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233792 00000100:00100000:3.0:1789579161.728241:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233792 00000100:00100000:3.0:1789579161.728289:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427072 00000100:00100000:3.0:1789579161.728292:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427072 00000100:00100000:3.0:1789579161.728314:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789579161.728324:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277233792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.728550:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277233792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.728561:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789579161.728620:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.728684:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.728753:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.728781:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579161.728801:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277233920 00000100:00100000:3.0:1789579161.728805:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277233920 00000100:00100000:3.0:1789579161.728824:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:3.0:1789579161.728831:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14878:x1876509261427072:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.728929:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:14878:x1876509261427072:12345-192.168.203.37@tcp:503:ll_cfg_requeue.0 Request processed in 97us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.728936:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 155 00000100:00100000:3.0:1789579161.728956:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789579161.728960:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277233920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.729023:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277233920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.729030:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789579161.729070:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277233920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789579161.741199:0:20176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789579161.741402:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789579161.741446:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789579161.741861:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.741878:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939401519000/0xd90373d592f22394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f2239b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789579161.741892:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789579161.741895:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93940f414000 from 13 10000000:01000000:0.0:1789579161.741899:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789579161.741956:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.741966:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.741979:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579161.742014:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.743243:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.743334:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234048 00000100:00100000:3.0:1789579161.743371:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234048 00000100:00100000:3.0:1789579161.743448:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789579161.743460:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+21:17115:x1876509277234048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579161.743481:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579161.743501:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939302b2f600/0xd90373d592f223a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f223a2 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.743533:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939302b2f600/0xd90373d592f223a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f223a2 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.743577:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939302b2f600/0xd90373d592f223a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f223a2 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.743588:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f600, rc 0) 00000100:00100000:3.0:1789579161.743653:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.743660:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789579161.744719:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941031a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579161.744759:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579161.744905:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.744943:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579161.745053:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.746401:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579161.746466:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941031a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579161.746506:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234176 00000100:00100000:3.0:1789579161.746518:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234176 00000100:00100000:3.0:1789579161.746589:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789579161.746600:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.746787:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.746795:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789579161.747716:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.748238:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.748326:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579161.748399:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941031a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579161.749978:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234304 00000100:00100000:3.0:1789579161.749995:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234304 00000100:00100000:3.0:1789579161.750676:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789579161.750690:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.751019:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.751028:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789579161.751287:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304197480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789579161.753021:0:20177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789579161.753402:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789579161.753450:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579161.753464:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.753494:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939303437000/0xd90373d592f223a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223a9 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579161.753506:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789579161.753510:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93943f640800 from 13 10000000:01000000:3.0:1789579161.753513:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579161.753574:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.753583:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.753595:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579161.753626:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.753703:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.753831:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579161.754491:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234432 00000100:00100000:0.0:1789579161.754504:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234432 00000100:00100000:0.0:1789579161.754573:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789579161.754585:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+22:17115:x1876509277234432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789579161.754603:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579161.754622:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939303436200/0xd90373d592f223b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f223b0 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.754653:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939303436200/0xd90373d592f223b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f223b0 expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.754665:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939303436200/0xd90373d592f223b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f223b0 expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579161.754674:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436200, rc 0) 00000100:00100000:0.0:1789579161.755070:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 484us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579161.755086:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789579161.755173:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789579161.755197:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.755208:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579161.755289:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.755322:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.755402:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579161.756507:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234560 00000100:00100000:0.0:1789579161.756522:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234560 00000100:00100000:0.0:1789579161.756612:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789579161.756624:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.762774:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6137us (7435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579161.762796:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789579161.762856:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.762938:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.762993:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.763037:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789579161.763044:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234688 00000100:00100000:0.0:1789579161.763056:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234688 00000100:00100000:0.0:1789579161.763114:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789579161.763125:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.763288:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394372b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579161.763296:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789579161.763320:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eaf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789579161.765289:0:20178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789579161.766725:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789579161.766770:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789579161.766798:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.766814:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2e000/0xd90373d592f223b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223b7 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789579161.766829:0:17115:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789579161.766832:0:17115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff939304130800 from 13 10000000:01000000:3.0:1789579161.766836:0:17115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789579161.766895:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.766905:0:17115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579161.766919:0:17115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579161.766953:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939408eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789579161.767050:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.767118:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a01600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579161.769889:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234816 00000100:00100000:2.0:1789579161.769916:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234816 00000100:00100000:2.0:1789579161.769982:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789579161.769994:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+23:17115:x1876509277234816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789579161.770015:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579161.770039:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939400031c00/0xd90373d592f223c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd90373d592f223be expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579161.770230:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939400031c00/0xd90373d592f223c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd90373d592f223be expref: 24 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579161.770244:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939400031c00/0xd90373d592f223c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd90373d592f223be expref: 24 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579161.770255:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031c00, rc 0) 00000100:00100000:2.0:1789579161.770378:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277234816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 386us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579161.770386:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789579161.770433:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939408eace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789579161.770459:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579161.770479:0:17115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579161.770591:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.770634:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579161.770688:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408fb1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789579161.771240:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277234944 00000100:00100000:2.0:1789579161.771248:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277234944 00000100:00100000:2.0:1789579161.771292:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789579161.771301:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277234944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789579161.771487:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277234944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579161.771494:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789579161.771579:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277234944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.771623:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277235072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789579161.771680:0:17115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579161.771705:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408fb1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789579161.771729:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235072 00000100:00100000:0.0:1789579161.771736:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235072 00000100:00100000:0.0:1789579161.771758:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789579161.771765:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277235072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789579161.771891:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:044b3bf9-43fa-4501-b924-7b81ca047525+24:17115:x1876509277235072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579161.771899:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789579161.772071:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:044b3bf9-43fa-4501-b924-7b81ca047525:17115:1876509277235072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789579161.773315:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789579161.774023:0:17115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789579161.774057:0:17115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789579161.774084:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579161.774099:0:17115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.137@tcp lock: ffff939302b2fa00/0xd90373d592f223be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd90373d592f223c5 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579161.963163:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789579161.963196:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277235200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789579161.963294:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579161.963343:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235200 00000100:00100000:3.0:1789579161.963386:0:18626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235200 00000100:00100000:3.0:1789579161.963455:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579161.963466:0:18626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277235200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789579161.963497:0:18626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579161.963568:0:18626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277235200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579161.963575:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789579161.963654:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277235200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789579162.531826:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579162.743138:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579162.743290:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579162.743322:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579162.743389:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427584 00000100:00100000:3.0:1789579162.743403:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427584 00000100:00100000:3.0:1789579162.743497:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:3.0:1789579162.743510:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427584:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579162.743623:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427584:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579162.743632:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00080000:0.0:1789579162.745795:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789579162.747887:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579162.747935:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579162.747963:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579162.748019:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428096 00000100:00100000:0.0:1789579162.748032:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428096 00000100:00100000:0.0:1789579162.748123:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:0.0:1789579162.748154:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261428096:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579162.748270:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261428096:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 118us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579162.748278:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00080000:0.0:1789579162.748463:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789579162.754940:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427328 00000100:00100000:1.0:1789579162.754961:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427328 00000100:00080000:0.0:1789579162.755216:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579162.755508:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427840 00000100:00100000:1.0:1789579162.755514:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427840 00000100:00100000:1.0:1789579162.755572:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:1.0:1789579162.755584:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261427328:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579162.755705:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261427328:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 123us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579162.755714:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:1.0:1789579162.755736:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:1.0:1789579162.755743:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2395:x1876509261427840:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579162.755791:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2395:x1876509261427840:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 48us (12468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579162.755798:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00080000:0.0:1789579162.755883:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579162.756488:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579162.758459:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427712 00000100:00100000:0.0:1789579162.758482:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427712 00000100:00100000:0.0:1789579162.758590:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:0.0:1789579162.758606:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427712:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579162.758698:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427712:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 98us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579162.758706:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00080000:0.0:1789579162.758738:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579162.758830:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427456 00000100:00100000:1.0:1789579162.758836:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427456 00000100:00100000:1.0:1789579162.758885:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789579162.758893:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427456:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579162.758927:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261427456:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 36us (10963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579162.758934:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:1.0:1789579162.760668:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427200 00000100:00100000:1.0:1789579162.760687:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427200 00000100:00100000:1.0:1789579162.760750:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:1.0:1789579162.760759:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2395:x1876509261427200:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579162.760828:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2395:x1876509261427200:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 69us (12892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579162.760835:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 166 00000100:00100000:2.0:1789579162.761018:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579162.762513:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00080000:0.0:1789579162.762762:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579162.762839:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261427968 00000100:00100000:1.0:1789579162.762850:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261427968 00000100:00100000:1.0:1789579162.762936:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789579162.762947:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261427968:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579162.763017:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261427968:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 72us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579162.763024:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:3.0:1789579162.763303:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428224 00000100:00100000:3.0:1789579162.763308:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428224 00000100:00100000:3.0:1789579162.763375:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:3.0:1789579162.763383:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261428224:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579162.763419:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261428224:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 37us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579162.763426:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00080000:0.0:1789579162.764489:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789579162.764498:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579163.491625:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789579163.491655:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277235328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789579163.491722:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579163.491769:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235328 00000100:00100000:1.0:1789579163.491776:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235328 00000100:00100000:1.0:1789579163.491818:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789579163.491827:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277235328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789579163.491859:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789579163.491902:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277235328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579163.491910:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789579163.491957:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277235328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789579163.492267:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277235456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789579163.492299:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579163.492466:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235456 00000100:00100000:0.0:1789579163.492471:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235456 00000100:00100000:0.0:1789579163.492496:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789579163.492503:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277235456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579163.492521:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789579163.492581:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277235456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579163.492587:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789579163.492658:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277235456:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789579163.562089:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789579164.582434:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579165.259332:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.259491:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428352 00000100:00100000:1.0:1789579165.259500:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428352 00000100:00100000:1.0:1789579165.259581:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:1.0:1789579165.259593:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:15548:x1876509261428352:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1789579165.259740:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789579165.259789:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.259815:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f223cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3a5 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259874:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259884:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259895:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259919:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259924:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.259989:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260055:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260060:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260065:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579165.260085:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579165.260088:0:17118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579165.260138:0:17118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260240:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260246:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260251:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260262:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579165.260264:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260270:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260279:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:1.0:1789579165.260281:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579165.260285:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260289:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f223d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260299:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260302:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260306:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260309:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579165.260310:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260314:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260324:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93940905bb00) 00010000:00010000:1.0:1789579165.260325:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579165.260327:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260330:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f223da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260551:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f223cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3a5 expref: 8 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260567:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518c00/0xd90373d592f223e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3a5 expref: 7 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.260574:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93940905b000) 00010000:00010000:1.0:1789579165.260577:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579165.260579:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518c00, rc 0) 00000100:00100000:1.0:1789579165.260677:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15548:x1876509261428352:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.260685:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789579165.269861:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.269960:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428480 00000100:00100000:0.0:1789579165.269970:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428480 00000100:00100000:0.0:1789579165.270035:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579165.270434:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15548:x1876509261428480:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789579165.270531:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15548:x1876509261428480:12345-192.168.203.37@tcp:900:lhsmtool_posix.0 Request processed in 486us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579165.270538:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579165.273265:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579165.273312:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428736 00000100:00100000:3.0:1789579165.273321:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428736 00000100:00100000:3.0:1789579165.273557:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789579165.273567:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15548:x1876509261428736:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789579165.273597:0:17119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579165.273614:0:17119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f223e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.273884:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.273899:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.273910:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274033:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274043:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274111:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274217:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e600/0xd90373d592f223fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274226:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e600/0xd90373d592f223fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274234:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e600/0xd90373d592f223fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579165.274243:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789579165.274484:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274492:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274499:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274505:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579165.274518:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274526:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274538:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93940905b000) 00010000:00010000:3.0:1789579165.274541:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579165.274547:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274552:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f223ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274567:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274573:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274578:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274593:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2ec00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579165.274596:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274603:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274612:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9394039ced00) 00010000:00010000:3.0:1789579165.274614:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579165.274617:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.274622:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f223f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.276210:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f223e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ac expref: 10 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.276234:0:17119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e600/0xd90373d592f223fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ac expref: 9 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.276242:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9394039cee00) 00010000:00010000:3.0:1789579165.276246:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579165.276248:0:17119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e600, rc 0) 00000100:00100000:3.0:1789579165.276313:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15548:x1876509261428736:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2747us (3055us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789579165.276321:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:2.0:1789579165.287627:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.287742:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428864 00000100:00100000:1.0:1789579165.287761:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428864 00000100:00100000:1.0:1789579165.287845:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789579165.287855:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15548:x1876509261428864:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789579165.287967:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15548:x1876509261428864:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.287974:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789579165.301639:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.302474:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261428992 00000100:00100000:1.0:1789579165.302489:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261428992 00000100:00100000:1.0:1789579165.302599:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:1.0:1789579165.302613:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15548:x1876509261428992:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789579165.302687:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789579165.304226:0:17120:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1522us 00000100:00100000:1.0:1789579165.311035:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15548:x1876509261428992:12345-192.168.203.37@tcp:59:lhsmtool_posix.0 Request processed in 8419us (9405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.311045:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:0.0:1789579165.326697:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579165.328360:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429120 00000100:00100000:2.0:1789579165.328376:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429120 00000100:00100000:2.0:1789579165.328828:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789579165.328840:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15554:x1876509261429120:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579165.328861:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579165.328881:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f2240b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3b3 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.328942:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.328956:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.328987:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329003:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329011:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329018:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329192:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329200:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329207:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329222:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579165.329227:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329235:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329248:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:2.0:1789579165.329252:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579165.329258:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329270:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329283:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329289:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329295:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329300:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579165.329303:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329309:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329316:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93942ef59b00) 00010000:00010000:2.0:1789579165.329319:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579165.329322:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329327:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22419 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329374:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f2240b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3b3 expref: 10 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329819:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:2.0:1789579165.329821:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579165.329826:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f2240b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3b3 expref: 10 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.329837:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031400, rc 0) 00000100:00100000:2.0:1789579165.329910:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15554:x1876509261429120:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1071us (3222us total) trans 0 rc 301/301 00000100:00100000:2.0:1789579165.329917:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:0.0:1789579165.333583:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579165.333696:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429248 00000100:00100000:3.0:1789579165.333715:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429248 00000100:00100000:3.0:1789579165.333809:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789579165.333820:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15554:x1876509261429248:12345-192.168.203.37@tcp:700:lfs.0 00000100:00100000:3.0:1789579165.333910:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9393043a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15554:x1876509261429248:12345-192.168.203.37@tcp:700:lfs.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579165.333919:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789579165.336538:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.336657:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429504 00000100:00100000:0.0:1789579165.336672:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429504 00000100:00100000:0.0:1789579165.336743:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789579165.336753:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:15554:x1876509261429504:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:0.0:1789579165.336805:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579165.336830:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22339 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec320 expref: 9 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.336850:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:0.0:1789579165.336856:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789579165.336912:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.336925:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 5 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.336946:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.336979:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 5 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.336992:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 5 pid: 17120 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579165.337005:0:17119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17119:1876509277235584:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579165.337132:0:17119:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789579165.341110:0:17119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17119:1876509277235584:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579165.341144:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579165.349707:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.350065:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429632 00000100:00100000:1.0:1789579165.350074:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429632 00010000:00010000:1.0:1789579165.350132:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 6 pid: 17120 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789579165.350173:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1789579165.350234:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789579165.350280:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789579165.350291:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:2395:x1876509261429632:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579165.350307:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579165.350314:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 6 pid: 17120 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350330:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 6 pid: 17120 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350394:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e400/0xd90373d592f22378 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec390 expref: 6 pid: 17120 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350410:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:1.0:1789579165.350428:0:17103:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350438:0:17103:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350447:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.350595:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579165.350662:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261429632:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 372us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.350670:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00010000:00010000:0.0:1789579165.351664:0:17119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.351675:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.351700:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.351709:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.351731:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353605:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353624:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353635:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579165.353662:0:17119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf92eb3 reply state 00000000fd8f666a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353674:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353681:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:0.0:1789579165.353684:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579165.353688:0:17119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789579165.353693:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789579165.353701:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353708:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353714:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353720:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579165.353731:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353739:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353750:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93942ef59100) 00010000:00010000:0.0:1789579165.353752:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579165.353756:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353762:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f22420 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579165.353783:0:17119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf92eb3 reply state 00000000fd8f666a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353791:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.353797:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939302356a00) 00010000:00010000:0.0:1789579165.353799:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579165.353801:0:17119:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789579165.353899:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+10:15554:x1876509261429504:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 17144us (17373us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789579165.353908:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:2.0:1789579165.464519:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.464628:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429760 00000100:00100000:1.0:1789579165.464640:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429760 00000100:00100000:1.0:1789579165.464746:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:1.0:1789579165.464758:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+10:15562:x1876509261429760:12345-192.168.203.37@tcp:101:lctl.0 00010000:00010000:1.0:1789579165.464788:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.464814:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f22435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3ba expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.464906:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.464923:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.464937:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579165.464992:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579165.465010:0:18390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579165.465072:0:18390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.465101:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f22435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ba expref: 12 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.465123:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519e00/0xd90373d592f2243c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3ba expref: 11 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.465133:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:1.0:1789579165.465138:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579165.465142:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519e00, rc 0) 00000100:00100000:1.0:1789579165.465218:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+11:15562:x1876509261429760:12345-192.168.203.37@tcp:101:lctl.0 Request processed in 462us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.465225:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 29 00000100:00100000:2.0:1789579165.483821:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.483994:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261429888 00000100:00100000:1.0:1789579165.484007:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261429888 00000100:00100000:1.0:1789579165.484223:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:1.0:1789579165.484235:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:15563:x1876509261429888:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579165.484261:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.484286:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f22443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3c1 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484489:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484507:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484555:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579165.484617:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579165.484621:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579165.484644:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484674:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f22443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c1 expref: 7 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484696:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519400/0xd90373d592f2244a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c1 expref: 6 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.484706:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:1.0:1789579165.484710:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579165.484714:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519400, rc 0) 00000100:00100000:1.0:1789579165.484841:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:15563:x1876509261429888:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 608us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.484849:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 30 00000100:00100000:0.0:1789579165.487654:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579165.487750:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261430016 00000100:00100000:2.0:1789579165.487763:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261430016 00000100:00100000:1.0:1789579165.487983:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:1.0:1789579165.487998:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+6:15563:x1876509261430016:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579165.488025:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.488175:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f22451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3c8 expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488258:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488291:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488304:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488317:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488325:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488332:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488447:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488455:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488462:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579165.488521:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579165.488525:0:18390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579165.488551:0:18390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488565:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488583:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488592:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488598:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579165.488604:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488613:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488626:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:1.0:1789579165.488629:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579165.488635:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488641:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f22458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488656:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488662:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488667:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488672:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579165.488680:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488688:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488696:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939302356a00) 00010000:00010000:1.0:1789579165.488698:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579165.488702:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488708:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f2245f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488738:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f22451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c8 expref: 8 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488751:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c8 expref: 7 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.488758:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:1.0:1789579165.488760:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579165.488763:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518e00, rc 0) 00000100:00100000:1.0:1789579165.488933:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+7:15563:x1876509261430016:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 937us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.488941:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 31 00000100:00100000:2.0:1789579165.493973:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.498585:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261430144 00000100:00100000:0.0:1789579165.498607:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261430144 00000100:00100000:0.0:1789579165.498736:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:0.0:1789579165.498749:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:15563:x1876509261430144:12345-192.168.203.37@tcp:900:lfs.0 00000100:00100000:0.0:1789579165.498894:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:15563:x1876509261430144:12345-192.168.203.37@tcp:900:lfs.0 Request processed in 148us (4933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579165.498903:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00080000:2.0:1789579165.499060:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579165.508519:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.510394:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261430400 00000100:00100000:0.0:1789579165.510413:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261430400 00000100:00100000:0.0:1789579165.510523:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:0.0:1789579165.510536:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+7:15563:x1876509261430400:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579165.510563:0:17119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579165.510589:0:17119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f2246d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3cf expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579165.510720:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789579165.510844:0:17119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f2246d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3cf expref: 9 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.510861:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:0.0:1789579165.510864:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789579165.510870:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f2246d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3cf expref: 9 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.510890:0:17119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939303436600, rc 0) 00000100:00100000:0.0:1789579165.511462:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+8:15563:x1876509261430400:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 926us (2966us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789579165.511472:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 32 00000100:00100000:1.0:1789579165.515559:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579165.521719:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261430656 00000100:00100000:2.0:1789579165.521740:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261430656 00000100:00100000:2.0:1789579165.521860:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:2.0:1789579165.521873:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+8:15563:x1876509261430656:12345-192.168.203.37@tcp:36:lfs.0 00010000:00010000:2.0:1789579165.521946:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579165.521982:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22466 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3c8 expref: 8 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.522009:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579165.522032:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579165.522064:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.522080:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.522091:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789579165.522766:0:17118:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017746a63 reply state 0000000053be203e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.522786:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.522792:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579165.522795:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789579165.522798:0:17118:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789579165.522808:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789579165.523517:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+9:15563:x1876509261430656:12345-192.168.203.37@tcp:36:lfs.0 Request processed in 1633us (8164us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789579165.523527:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 33 00000100:00100000:3.0:1789579165.525629:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.527735:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261430912 00000100:00100000:0.0:1789579165.527755:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261430912 00000100:00100000:0.0:1789579165.527835:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:0.0:1789579165.527866:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+9:15563:x1876509261430912:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:0.0:1789579165.528445:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+10:15563:x1876509261430912:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 579us (2825us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789579165.528456:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789579165.532772:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579165.532877:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431168 00000100:00100000:2.0:1789579165.532892:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431168 00000100:00100000:2.0:1789579165.532975:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:2.0:1789579165.532987:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+10:15563:x1876509261431168:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579165.533019:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579165.533058:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3d6 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533173:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533190:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533204:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533217:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533225:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533232:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579165.533398:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789579165.533485:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533492:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533500:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533507:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579165.533522:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533542:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533558:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:2.0:1789579165.533562:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579165.533568:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533576:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f22489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533592:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533598:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533605:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533611:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579165.533614:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533621:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533627:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939302356a00) 00010000:00010000:2.0:1789579165.533629:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579165.533632:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533646:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22490 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533688:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22482 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3d6 expref: 12 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533700:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:2.0:1789579165.533702:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579165.533706:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3d6 expref: 12 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579165.533716:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031e00, rc 0) 00000100:00100000:2.0:1789579165.534662:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+11:15563:x1876509261431168:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1668us (1894us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789579165.534673:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 34 00000100:00100000:3.0:1789579165.539431:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.539502:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431296 00000100:00100000:1.0:1789579165.539526:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431296 00000100:00100000:1.0:1789579165.539617:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:1.0:1789579165.539646:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+11:15563:x1876509261431296:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579165.539679:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.539708:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f2249e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3dd expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.539845:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.539862:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.539876:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579165.540014:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789579165.540019:0:18390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789579165.540153:0:18390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.540187:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519a00/0xd90373d592f2249e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 13 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.540211:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 12 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.540221:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:1.0:1789579165.540225:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579165.540229:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518a00, rc 0) 00000100:00100000:1.0:1789579165.540307:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:15563:x1876509261431296:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 664us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.540327:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 35 00000100:00100000:1.0:1789579165.544341:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.544576:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431424 00000100:00100000:0.0:1789579165.544591:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431424 00000100:00100000:0.0:1789579165.544672:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:0.0:1789579165.544685:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:15563:x1876509261431424:12345-192.168.203.37@tcp:37:lfs.0 00000100:00100000:1.0:1789579165.559182:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:15563:x1876509261431424:12345-192.168.203.37@tcp:37:lfs.0 Request processed in 14481us (14838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.559203:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:3.0:1789579165.569570:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.570233:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431680 00000100:00100000:1.0:1789579165.570244:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431680 00000100:00100000:1.0:1789579165.570304:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 4 00000100:00100000:1.0:1789579165.570313:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939407158c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:15563:x1876509261431680:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789579165.570608:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939407158c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+13:15563:x1876509261431680:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 295us (1046us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789579165.571193:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 4 00010000:00010000:1.0:1789579165.608470:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789579165.664826:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.665186:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431808 00000100:00100000:0.0:1789579165.665199:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431808 00000100:00100000:0.0:1789579165.665549:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:0.0:1789579165.665564:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+11:15569:x1876509261431808:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579165.665594:0:17119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579165.665621:0:17119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f224ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3e4 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665706:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665724:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665738:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665751:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665782:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.665790:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.672118:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.672153:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.672169:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579165.672229:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789579165.672233:0:17119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579165.673773:0:17119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673805:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673813:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673820:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673827:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579165.673833:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673863:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673883:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:0.0:1789579165.673887:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579165.673893:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673900:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673928:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673936:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673943:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673949:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939304366e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579165.673951:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673958:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673966:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939302356a00) 00010000:00010000:0.0:1789579165.673969:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579165.673972:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.673988:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.674037:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f224ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3e4 expref: 13 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.674057:0:17119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366400/0xd90373d592f224c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3e4 expref: 12 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.674066:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:0.0:1789579165.674068:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789579165.674071:0:17119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366400, rc 0) 00000100:00100000:0.0:1789579165.674184:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:15569:x1876509261431808:12345-192.168.203.37@tcp:101:bash.0 Request processed in 8622us (9370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579165.674194:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 36 00000100:00100000:0.0:1789579165.688126:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579165.688221:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261431936 00000100:00100000:2.0:1789579165.688232:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261431936 00000100:00100000:2.0:1789579165.688306:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:2.0:1789579165.688317:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15569:x1876509261431936:12345-192.168.203.37@tcp:900:bash.0 00000100:00100000:2.0:1789579165.688591:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:15569:x1876509261431936:12345-192.168.203.37@tcp:900:bash.0 Request processed in 274us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579165.688598:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579165.693615:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579165.693796:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261432192 00000100:00100000:1.0:1789579165.693810:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261432192 00000100:00100000:1.0:1789579165.693887:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:1.0:1789579165.693900:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+12:15569:x1876509261432192:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:1.0:1789579165.693928:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579165.693956:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f224c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3eb expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.694122:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.694143:0:18390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 12 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.694172:0:18390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.694221:0:18390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 12 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579165.694237:0:18390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 12 pid: 18390 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579165.694256:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277235712:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579165.694414:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789579165.704670:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303bd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277235712:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579165.704714:0:18390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579165.705003:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.705120:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261432320 00000100:00100000:0.0:1789579165.705129:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261432320 00010000:00010000:0.0:1789579165.705183:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 13 pid: 18390 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579165.705227:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 16 00000100:00100000:0.0:1789579165.705240:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+13:2394:x1876509261432320:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579165.705451:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579165.705461:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 13 pid: 18390 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705499:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 13 pid: 18390 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705542:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f224a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3dd expref: 13 pid: 18390 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705564:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:0.0:1789579165.705570:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705581:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705591:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.705624:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579165.705687:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:2394:x1876509261432320:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 450us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579165.705695:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 16 00010000:00010000:3.0:1789579165.706748:0:18390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.706765:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.706797:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.706810:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.706842:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707284:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707292:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707816:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579165.707831:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789579165.707861:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707870:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707877:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707884:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579165.707888:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707895:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707907:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:3.0:1789579165.707910:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789579165.707924:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707930:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f224cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789579165.707944:0:18390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8bd23f4 reply state 00000000f133ac17 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707955:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.707962:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9394039ced00) 00010000:00010000:3.0:1789579165.707964:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789579165.707967:0:18390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789579165.708005:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f224c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 15 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.708021:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 14 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.708028:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579165.708031:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789579165.709211:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2ec00, rc 0) 00000100:00100000:3.0:1789579165.711938:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+15:15569:x1876509261432192:12345-192.168.203.37@tcp:101:bash.0 Request processed in 15398us (15695us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789579165.711954:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 37 00000100:00100000:1.0:1789579165.751649:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579165.751752:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261432448 00000100:00100000:0.0:1789579165.751770:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261432448 00000100:00100000:0.0:1789579165.751858:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:0.0:1789579165.751870:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+15:15569:x1876509261432448:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579165.751904:0:17119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579165.751930:0:17119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3f2 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752041:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752059:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752073:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579165.752144:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789579165.752149:0:17119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579165.752173:0:17119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752185:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752215:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366c00/0xd90373d592f224eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3f2 expref: 17 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752241:0:17119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3f2 expref: 16 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579165.752639:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579165.752643:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579165.752647:0:17119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366e00, rc 0) 00000100:00100000:1.0:1789579165.754561:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:15569:x1876509261432448:12345-192.168.203.37@tcp:101:bash.0 Request processed in 2678us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579165.754576:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 38 00000100:00100000:1.0:1789579165.761140:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579165.761426:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261432704 00000100:00100000:3.0:1789579165.761439:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261432704 00000100:00100000:3.0:1789579165.761501:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:3.0:1789579165.761521:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:15569:x1876509261432704:12345-192.168.203.37@tcp:35:bash.0 00000100:00100000:3.0:1789579165.762076:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+17:15569:x1876509261432704:12345-192.168.203.37@tcp:35:bash.0 Request processed in 563us (946us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789579165.762085:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 5 00000100:00100000:0.0:1789579165.907968:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579165.908272:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261432960 00000100:00100000:3.0:1789579165.908286:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261432960 00000100:00100000:3.0:1789579165.908405:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:3.0:1789579165.908416:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+17:15579:x1876509261432960:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:3.0:1789579165.908447:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579165.908472:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f224f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec3f9 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579165.908608:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789579165.908731:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f224f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3f9 expref: 19 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.908748:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:3.0:1789579165.908752:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789579165.908758:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f224f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3f9 expref: 19 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579165.908776:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e200, rc 0) 00000100:00100000:3.0:1789579165.908861:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15579:x1876509261432960:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 447us (906us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789579165.908878:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 39 00000100:00100000:0.0:1789579165.920335:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579165.920519:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261433216 00000100:00100000:3.0:1789579165.920532:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261433216 00000100:00100000:3.0:1789579165.920613:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 6 00000100:00100000:3.0:1789579165.920644:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15579:x1876509261433216:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:3.0:1789579165.920968:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+19:15579:x1876509261433216:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 327us (646us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789579165.920977:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 6 00000040:00080000:0.0:1789579165.988170:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789579166.006803:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579166.010662:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261433472 00000100:00100000:1.0:1789579166.010684:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261433472 00000100:00100000:1.0:1789579166.010792:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:1.0:1789579166.010805:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+19:15582:x1876509261433472:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:1.0:1789579166.010836:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579166.010862:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22507 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec400 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.011007:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f2250e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.011045:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f2250e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.011062:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f2250e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579166.011076:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789579166.011218:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22507 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec400 expref: 22 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.011241:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f2250e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec400 expref: 21 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.011251:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:1.0:1789579166.011254:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789579166.011259:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518000, rc 0) 00000100:00100000:1.0:1789579166.012238:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:15582:x1876509261433472:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 1426us (5440us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789579166.012248:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 40 00000100:00100000:0.0:1789579166.025450:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579166.025514:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579166.026224:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261433728 00000100:00100000:1.0:1789579166.026239:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261433728 00000100:00100000:1.0:1789579166.026336:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:1.0:1789579166.026367:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:2393:x1876509261433728:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789579166.026387:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789579166.026418:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518000/0xd90373d592f2250e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec400 expref: 21 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579166.026463:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:1.0:1789579166.026469:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579166.026547:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:2393:x1876509261433728:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 201us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579166.026555:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 0 00000100:00100000:3.0:1789579166.030690:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261433600 00000100:00100000:3.0:1789579166.030712:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261433600 00000100:00100000:3.0:1789579166.030805:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:3.0:1789579166.030818:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:15582:x1876509261433600:12345-192.168.203.37@tcp:54:lfs.0 00010000:00010000:3.0:1789579166.030926:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.030948:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.030964:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031012:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031021:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031029:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031036:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2e200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:3.0:1789579166.031041:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031070:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031086:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579166.031090:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789579166.031096:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.031102:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f2251c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579166.031213:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:15582:x1876509261433600:12345-192.168.203.37@tcp:54:lfs.0 Request processed in 396us (5775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.031222:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 41 00000100:00100000:0.0:1789579166.036863:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579166.037463:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261433984 00000100:00100000:1.0:1789579166.037478:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261433984 00000100:00100000:1.0:1789579166.037564:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:1.0:1789579166.037583:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:15582:x1876509261433984:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789579166.037866:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:15582:x1876509261433984:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 291us (1015us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789579166.037874:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 7 00000100:00100000:3.0:1789579166.051781:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789579166.051814:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277235840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789579166.051925:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052246:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277235968:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052307:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052334:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277236480:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052389:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052406:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277236992:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052429:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052446:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789579166.052451:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277236096:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052471:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052485:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277236608:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052515:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.052531:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277237120:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.052551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.052905:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235968 00000100:00100000:3.0:1789579166.052915:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235968 00000100:00100000:3.0:1789579166.052977:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789579166.052987:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3617:x1876509277235968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053050:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:044b3bf9-43fa-4501-b924-7b81ca047525+24:3617:x1876509277235968:12345-0@lo:400:kworker.0 Request processed in 64us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.053058:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789579166.053094:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277236224:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053116:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.053136:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277236736:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053169:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.053186:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277237248:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053208:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.053231:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789579166.053238:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277236352:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053261:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.053278:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277236864:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053299:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.053310:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277237376:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.053330:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579166.054013:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:044b3bf9-43fa-4501-b924-7b81ca047525:3617:1876509277235968:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.054050:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236992 00000100:00100000:2.0:1789579166.054055:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236992 00000100:00080000:2.0:1789579166.054079:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579166.054106:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237120 00000100:00100000:2.0:1789579166.054109:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237120 00000100:00080000:2.0:1789579166.054120:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579166.054131:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237248 00000100:00100000:2.0:1789579166.054134:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237248 00000100:00080000:2.0:1789579166.054143:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789579166.054152:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236352 00000100:00100000:2.0:1789579166.054155:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236352 00000100:00100000:2.0:1789579166.054164:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236864 00000100:00100000:2.0:1789579166.054166:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236864 00000100:00100000:2.0:1789579166.054175:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237376 00000100:00100000:2.0:1789579166.054177:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237376 00000100:00080000:2.0:1789579166.054195:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789579166.054209:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789579166.054216:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277236992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.054267:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1876509277236992:12345-0@lo:400:kworker.0 Request processed in 51us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579166.054273:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789579166.054298:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876509277236992:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.054326:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789579166.054332:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277237120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579166.055280:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236480 00000100:00100000:1.0:1789579166.055293:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236480 00000100:00100000:1.0:1789579166.055336:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236096 00000100:00100000:1.0:1789579166.055339:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236096 00000100:00100000:1.0:1789579166.055376:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789579166.055384:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277236480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.055462:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236608 00000100:00100000:3.0:1789579166.055466:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236608 00000100:00100000:3.0:1789579166.055515:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236224 00000100:00100000:3.0:1789579166.055518:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236224 00000100:00100000:3.0:1789579166.055540:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277236736 00000100:00100000:3.0:1789579166.055542:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277236736 00000100:00100000:3.0:1789579166.055558:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789579166.055565:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277236608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579166.056684:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277235840 00000100:00100000:0.0:1789579166.056692:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277235840 00000100:00100000:0.0:1789579166.056749:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789579166.056758:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277235840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579166.056790:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789579166.061254:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277236480:12345-0@lo:400:kworker.0 Request processed in 5857us (8850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579166.061273:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789579166.061626:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277236608:12345-0@lo:400:kworker.0 Request processed in 6059us (9117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.061638:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789579166.061673:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579166.061688:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277236224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.061758:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277236224:12345-0@lo:400:kworker.0 Request processed in 77us (8641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.061764:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789579166.061795:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789579166.061802:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277236736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.061846:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277236736:12345-0@lo:400:kworker.0 Request processed in 44us (8676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.061852:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789579166.061887:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789579166.061893:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789579166.061937:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277236224:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.061949:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277236736:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.061989:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789579166.061998:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277237248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062034:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876509277237248:12345-0@lo:400:kworker.0 Request processed in 38us (8825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.062040:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789579166.062066:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876509277237248:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062083:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789579166.062089:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277236352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062118:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876509277236352:12345-0@lo:400:kworker.0 Request processed in 29us (8857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.062124:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789579166.062143:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876509277236352:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062158:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789579166.062164:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277236864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062225:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876509277236864:12345-0@lo:400:kworker.0 Request processed in 61us (8925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.062236:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789579166.062260:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876509277236864:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062277:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789579166.062284:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277237376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.062327:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876509277237376:12345-0@lo:400:kworker.0 Request processed in 44us (8996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.062333:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789579166.062904:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b15c00 x1876509277237376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579166.062919:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876509277237376:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.063004:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277237504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579166.063051:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579166.063088:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277236608:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.063101:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277236480:0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.066946:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789579166.066991:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277236096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789579166.067120:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277236096:12345-0@lo:400:kworker.0 Request processed in 154us (14647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.067128:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789579166.067331:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237504 00000100:00100000:1.0:1789579166.067344:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237504 00000100:00100000:1.0:1789579166.067402:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789579166.067410:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277237504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789579166.067457:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789579166.067501:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277237504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (4450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579166.067519:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789579166.067599:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277237632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579166.067642:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579166.067687:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237632 00000100:00100000:1.0:1789579166.067691:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237632 00000100:00100000:1.0:1789579166.067706:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789579166.067712:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277237632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789579166.067722:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789579166.067748:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876509277237632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579166.067754:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789579166.067799:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277237632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789579166.068172:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277237504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579166.068187:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277236096:0@lo:400:kworker.0 00000100:00100000:2.0:1789579166.069886:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876509277237120:12345-0@lo:400:kworker.0 Request processed in 15544us (17323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579166.069902:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789579166.071806:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277235840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15037us (19869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579166.071832:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789579166.072211:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277235840:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789579166.072778:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939303b16a00 x1876509277237120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789579166.072815:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876509277237120:0@lo:400:kworker.0 00000100:00100000:0.0:1789579166.486910:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579166.486988:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261434240 00000100:00100000:3.0:1789579166.487008:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261434240 00000100:00100000:3.0:1789579166.487078:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:3.0:1789579166.487089:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:15614:x1876509261434240:12345-192.168.203.37@tcp:101:cat.0 00010000:00010000:3.0:1789579166.487119:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579166.487145:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f22523 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec407 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.487275:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f2252a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.487292:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f2252a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.487307:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f2252a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789579166.487331:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789579166.487537:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f22523 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec407 expref: 24 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.487560:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f2252a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec407 expref: 23 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.487570:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579166.487574:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789579166.487593:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2f200, rc 0) 00000100:00100000:3.0:1789579166.487662:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:15614:x1876509261434240:12345-192.168.203.37@tcp:101:cat.0 Request processed in 575us (765us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789579166.487670:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 42 00000100:00100000:2.0:1789579166.491696:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579166.491822:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261434496 00000100:00100000:1.0:1789579166.491836:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261434496 00000100:00100000:1.0:1789579166.491915:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:1.0:1789579166.491928:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:15614:x1876509261434496:12345-192.168.203.37@tcp:35:cat.0 00000100:00100000:1.0:1789579166.492338:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:15614:x1876509261434496:12345-192.168.203.37@tcp:35:cat.0 Request processed in 411us (652us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789579166.492409:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 8 00000100:00100000:0.0:1789579166.498987:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579166.499193:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261434624 00000100:00100000:3.0:1789579166.499207:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261434624 00000100:00100000:3.0:1789579166.499291:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:3.0:1789579166.499304:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:2395:x1876509261434624:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579166.499325:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579166.499394:0:20146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f2252a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec407 expref: 24 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579166.499429:0:20146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579166.499436:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579166.499518:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:2395:x1876509261434624:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 216us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579166.499526:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 1 00000100:00100000:0.0:1789579166.630086:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579166.632312:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261434880 00000100:00100000:2.0:1789579166.632334:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261434880 00000100:00100000:2.0:1789579166.632457:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 43 00000100:00100000:2.0:1789579166.632470:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:15620:x1876509261434880:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789579166.632515:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579166.632543:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030800/0xd90373d592f22538 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec40e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.632709:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f2253f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.632726:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f2253f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.632760:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f2253f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579166.632775:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789579166.632964:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030800/0xd90373d592f22538 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec40e expref: 26 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.632989:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f2253f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec40e expref: 25 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.633000:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579166.633003:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579166.633007:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031200, rc 0) 00000100:00100000:2.0:1789579166.633288:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:15620:x1876509261434880:12345-192.168.203.37@tcp:101:dd.0 Request processed in 819us (3216us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789579166.633298:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 43 00010000:00010000:1.0:1789579166.633525:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579166.643773:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579166.643839:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579166.643928:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261435008 00000100:00100000:2.0:1789579166.643941:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261435008 00000100:00100000:2.0:1789579166.644018:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:2.0:1789579166.644040:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:15620:x1876509261435008:12345-192.168.203.37@tcp:101:dd.0 00010000:00010000:2.0:1789579166.644080:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579166.644107:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2254d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec415 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644151:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644189:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644204:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644343:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2254d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 27 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644401:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 26 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.644412:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579166.644415:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579166.644420:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939400031400, rc 0) 00000100:00100000:2.0:1789579166.644484:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+26:15620:x1876509261435008:12345-192.168.203.37@tcp:101:dd.0 Request processed in 456us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579166.644492:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 44 00000100:00100000:0.0:1789579166.644703:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261435136 00000100:00100000:0.0:1789579166.644717:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261435136 00000100:00100000:0.0:1789579166.644805:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:0.0:1789579166.644816:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+26:2393:x1876509261435136:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579166.644831:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579166.644854:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f2253f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec40e expref: 26 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579166.644875:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579166.644880:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579166.644940:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:2393:x1876509261435136:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 126us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579166.644948:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 2 00000100:00100000:3.0:1789579166.670507:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579166.670694:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261435392 00000100:00100000:2.0:1789579166.670709:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261435392 00000100:00100000:2.0:1789579166.670790:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 45 00000100:00100000:2.0:1789579166.670804:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:15620:x1876509261435392:12345-192.168.203.37@tcp:36:dd.0 00010000:00010000:2.0:1789579166.670915:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579166.670950:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f224f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3f2 expref: 25 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.670977:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579166.670990:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579166.671227:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.671245:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.671256:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789579166.671310:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789579166.671417:0:17120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093c2dd9d reply state 00000000d53b0732 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.671431:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579166.671438:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579166.671440:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789579166.671443:0:17120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789579166.671586:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+27:15620:x1876509261435392:12345-192.168.203.37@tcp:36:dd.0 Request processed in 777us (1093us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789579166.671595:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 45 00000020:00080000:2.0:1789579166.671601:0:17120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789579166.858812:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579166.859076:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261435648 00000100:00100000:2.0:1789579166.859085:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261435648 00000100:00100000:2.0:1789579166.859146:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 9 00000100:00100000:2.0:1789579166.859156:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+27:15620:x1876509261435648:12345-192.168.203.37@tcp:35:dd.0 00000100:00100000:2.0:1789579166.859394:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+28:15620:x1876509261435648:12345-192.168.203.37@tcp:35:dd.0 Request processed in 238us (590us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789579166.859402:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 9 00000040:00080000:0.0:1789579167.015150:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789579167.075873:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277237760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789579167.075974:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579167.076186:0:19911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277237760 00000100:00100000:2.0:1789579167.076197:0:19911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277237760 00000100:00100000:2.0:1789579167.076270:0:19911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789579167.076282:0:19911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277237760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789579167.076315:0:19911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789579167.076428:0:19911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277237760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.076435:0:19911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789579167.076599:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277237760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789579167.092536:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.093093:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261435776 00000100:00100000:2.0:1789579167.093107:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261435776 00000100:00100000:2.0:1789579167.093212:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00100000:2.0:1789579167.093227:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+28:15634:x1876509261435776:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789579167.093259:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579167.093286:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400030800/0xd90373d592f22562 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec41c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093409:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093428:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093444:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093459:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093468:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093491:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093628:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093638:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093646:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579167.093703:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789579167.093708:0:17118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579167.093755:0:17118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093769:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093779:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093786:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093794:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093801:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579167.093806:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093822:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093836:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579167.093839:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579167.093846:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093853:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031e00/0xd90373d592f22569 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093869:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093876:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093882:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093886:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400031200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579167.093889:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093894:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093901:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9394039ced00) 00010000:00010000:2.0:1789579167.093903:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579167.093906:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093923:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031200/0xd90373d592f22570 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093956:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030800/0xd90373d592f22562 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec41c expref: 30 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093974:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec41c expref: 29 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.093981:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.093984:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579167.093987:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789579167.094083:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+29:15634:x1876509261435776:12345-192.168.203.37@tcp:101:stat.0 Request processed in 860us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.094092:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 46 00000100:00080000:3.0:1789579167.096865:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789579167.184776:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.184904:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261436032 00000100:00100000:2.0:1789579167.184918:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261436032 00000100:00100000:2.0:1789579167.184992:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 47 00000100:00100000:2.0:1789579167.185003:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+29:15640:x1876509261436032:12345-192.168.203.37@tcp:36:truncate.0 00010000:00010000:2.0:1789579167.185082:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579167.185118:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22577 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec41c expref: 29 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.185145:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.185152:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579167.185431:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.185464:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.185477:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789579167.185541:0:17120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1789579167.185567:0:17120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018d985c7 reply state 0000000062357cba transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.185582:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.185588:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.185591:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789579167.185594:0:17120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789579167.185739:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+31:15640:x1876509261436032:12345-192.168.203.37@tcp:36:truncate.0 Request processed in 736us (976us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789579167.185747:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 47 00000020:00080000:2.0:1789579167.185753:0:17120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789579167.554553:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.555834:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261436160 00000100:00100000:2.0:1789579167.555857:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261436160 00000100:00100000:2.0:1789579167.555961:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 48 00000100:00100000:2.0:1789579167.555976:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+31:15654:x1876509261436160:12345-192.168.203.37@tcp:101:stat.0 00010000:00010000:2.0:1789579167.556011:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579167.556038:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22585 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec423 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556125:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556159:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556174:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556189:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556197:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.556205:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558144:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558169:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558183:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579167.558251:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789579167.558257:0:17118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789579167.558284:0:17118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558299:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558335:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558343:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558382:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558390:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afa00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579167.558395:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558404:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558419:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579167.558422:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579167.558428:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558434:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f2258c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558454:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558460:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558467:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558479:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579167.558483:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558490:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558511:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9394039ced00) 00010000:00010000:2.0:1789579167.558513:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579167.558517:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558523:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f22593 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558569:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f22585 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 33 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558588:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 32 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.558596:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.558599:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789579167.558601:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae400, rc 0) 00000100:00100000:2.0:1789579167.558688:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+32:15654:x1876509261436160:12345-192.168.203.37@tcp:101:stat.0 Request processed in 2715us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.558697:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 48 00010000:00010000:0.0:1789579167.657632:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789579167.723556:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.723688:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261436416 00000100:00100000:2.0:1789579167.723721:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261436416 00000100:00100000:2.0:1789579167.723808:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:2.0:1789579167.723821:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+32:15664:x1876509261436416:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:2.0:1789579167.723849:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579167.723876:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f225a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec42a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789579167.724012:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789579167.724151:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f225a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec42a expref: 34 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.724169:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:2.0:1789579167.724172:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789579167.724178:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae000/0xd90373d592f225a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec42a expref: 34 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.724211:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363ae000, rc 0) 00000100:00100000:2.0:1789579167.724296:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+33:15664:x1876509261436416:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 476us (754us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789579167.724304:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 49 00000100:00100000:0.0:1789579167.727522:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.727793:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261436672 00000100:00100000:2.0:1789579167.727806:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261436672 00000100:00100000:2.0:1789579167.727884:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:2.0:1789579167.727897:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93940715a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+33:15664:x1876509261436672:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:2.0:1789579167.728208:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93940715a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+34:15664:x1876509261436672:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 304us (691us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789579167.728217:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 10 00000100:00100000:3.0:1789579167.845194:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.848314:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261436928 00000100:00100000:0.0:1789579167.848338:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261436928 00000100:00100000:0.0:1789579167.848487:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:0.0:1789579167.848516:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+34:15670:x1876509261436928:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579167.848552:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579167.848579:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f225af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec431 expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848738:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848756:0:18390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 35 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848766:0:18390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 35 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848777:0:18390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848820:0:18390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 35 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.848860:0:18390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 35 pid: 17118 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579167.848878:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277237888:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579167.849000:0:18390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 35 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.849010:0:18390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 35 pid: 18390 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579167.849021:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277238016:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579167.849046:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579167.853756:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.853801:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.853909:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437184 00000100:00100000:2.0:1789579167.853922:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437184 00010000:00010000:2.0:1789579167.853978:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 36 pid: 18390 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579167.854024:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437056 00000100:00100000:2.0:1789579167.854027:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437056 00010000:00010000:2.0:1789579167.854043:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 37 pid: 17118 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579167.854069:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789579167.854081:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:2395:x1876509261437184:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579167.854100:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579167.854109:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 37 pid: 18390 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854122:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 37 pid: 18390 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854148:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.854154:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854164:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854171:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579167.854236:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:2395:x1876509261437184:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 156us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.854268:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 17 00000100:00100000:2.0:1789579167.854332:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 18 00000100:00100000:2.0:1789579167.854339:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:2395:x1876509261437056:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579167.854347:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579167.854397:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 36 pid: 17118 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854410:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 36 pid: 17118 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854421:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.854425:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854433:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854442:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.854464:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579167.854485:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:2395:x1876509261437056:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 147us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.854511:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 18 00010000:00010000:0.0:1789579167.857092:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363ae400/0xd90373d592f2259a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec423 expref: 35 pid: 17118 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579167.857125:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277237888:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579167.857139:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2ec00/0xd90373d592f224dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec3eb expref: 34 pid: 18390 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579167.857151:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277238016:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579167.857179:0:18390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.857190:0:18390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.857217:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579167.857246:0:18390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1789579167.857504:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436600/0xd90373d592f225af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 35 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.857531:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 34 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.857540:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579167.857544:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789579167.857548:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939304366e00, rc 0) 00000100:00100000:0.0:1789579167.858589:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+34:15670:x1876509261436928:12345-192.168.203.37@tcp:101:bash.0 Request processed in 10072us (13395us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1789579167.858602:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 50 00000100:00100000:1.0:1789579167.881921:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.882090:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.882210:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.882245:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.882342:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437440 00000100:00100000:0.0:1789579167.882369:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437440 00000100:00100000:0.0:1789579167.882443:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437952 00000100:00100000:0.0:1789579167.882447:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437952 00000100:00100000:0.0:1789579167.882473:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:0.0:1789579167.882484:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437440:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.882589:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437440:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 106us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.882597:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:0.0:1789579167.882618:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00100000:0.0:1789579167.882625:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261437952:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.882683:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261437952:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.882690:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 74 00000100:00080000:0.0:1789579167.882710:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789579167.898347:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.898404:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.898451:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437312 00000100:00100000:0.0:1789579167.898474:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437312 00000100:00100000:0.0:1789579167.898557:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:0.0:1789579167.898570:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2395:x1876509261437312:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.898663:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f7f6d69-9306-485c-8954-48c3fbe6cf31+13:2395:x1876509261437312:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.898671:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 168 00000100:00100000:3.0:1789579167.898748:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437696 00000100:00100000:3.0:1789579167.898754:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437696 00000100:00100000:3.0:1789579167.898843:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438208 00000100:00100000:3.0:1789579167.898853:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438208 00000100:00080000:0.0:1789579167.898871:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789579167.898879:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789579167.898887:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437696:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.898897:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:0.0:1789579167.898903:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261438208:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:3.0:1789579167.898926:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437696:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 39us (16835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.898926:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261438208:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 22us (16680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579167.898933:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:0.0:1789579167.898940:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789579167.899140:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.899172:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.899204:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.899227:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437568 00000100:00100000:1.0:1789579167.899231:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437568 00000100:00100000:1.0:1789579167.899260:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438080 00000100:00100000:1.0:1789579167.899263:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438080 00000100:00100000:1.0:1789579167.899285:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:1.0:1789579167.899292:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939420472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437568:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.900428:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261437824 00000100:00100000:0.0:1789579167.900443:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261437824 00000100:00100000:0.0:1789579167.900524:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438464 00000100:00100000:0.0:1789579167.900527:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438464 00000100:00100000:0.0:1789579167.900555:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:0.0:1789579167.900565:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:2395:x1876509261437824:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:0.0:1789579167.900644:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+12:2395:x1876509261437824:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 79us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579167.900650:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939420472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261437568:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 1357us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579167.900659:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:0.0:1789579167.900667:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 75 00000100:00100000:0.0:1789579167.900684:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 51 00000100:00100000:0.0:1789579167.900690:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+34:15670:x1876509261438464:12345-192.168.203.37@tcp:36:bash.0 00000100:00100000:1.0:1789579167.900871:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:1.0:1789579167.900880:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261438080:12345-192.168.203.37@tcp:400:kworker.0 00000100:00100000:1.0:1789579167.900910:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c259fca-ec9a-4b20-b3ac-ca463a9ba85c+5:2395:x1876509261438080:12345-192.168.203.37@tcp:400:kworker.0 Request processed in 31us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579167.900916:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00080000:1.0:1789579167.900947:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579167.900958:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789579167.901217:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.901238:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.901254:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789579167.901304:0:17119:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1789579167.901329:0:17119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060f04339 reply state 0000000079aa063d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.901342:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.901401:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579167.901405:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579167.901410:0:17119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789579167.904479:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15670:x1876509261438464:12345-192.168.203.37@tcp:36:bash.0 Request processed in 3768us (5253us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789579167.904503:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 51 00000020:00080000:2.0:1789579167.904536:0:17119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789579167.908213:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.910284:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438592 00000100:00100000:0.0:1789579167.910303:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438592 00000100:00100000:0.0:1789579167.910416:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:0.0:1789579167.910428:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15670:x1876509261438592:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579167.910460:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579167.910505:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f225cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec438 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.910603:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f225cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec438 expref: 38 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.910621:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f225cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec438 expref: 38 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.910643:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579167.910647:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789579167.910651:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ba00, rc 0) 00000100:00100000:0.0:1789579167.910736:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15670:x1876509261438592:12345-192.168.203.37@tcp:101:bash.0 Request processed in 310us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.910743:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 52 00000100:00100000:0.0:1789579167.916748:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579167.916913:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438720 00000100:00100000:3.0:1789579167.916927:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438720 00000100:00100000:3.0:1789579167.917005:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:3.0:1789579167.917017:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15670:x1876509261438720:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:3.0:1789579167.917044:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789579167.917072:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f225d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec43f expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579167.917193:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579167.917212:0:17120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 39 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579167.917223:0:17120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579167.917268:0:17120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 39 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579167.917284:0:17120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 39 pid: 18390 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579167.917336:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17120:1876509277238144:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579167.918295:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405a010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579167.941582:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.942225:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17120:1876509277238144:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579167.942265:0:17120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579167.942874:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261438848 00000100:00100000:2.0:1789579167.942887:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261438848 00010000:00010000:2.0:1789579167.942941:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 40 pid: 18390 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579167.942995:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 19 00000100:00100000:2.0:1789579167.943007:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+40:2395:x1876509261438848:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579167.943182:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579167.943192:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 40 pid: 18390 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943442:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 40 pid: 18390 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943471:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939304366e00/0xd90373d592f225b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec431 expref: 40 pid: 18390 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943503:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.943510:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943522:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943531:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.943570:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579167.943820:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+39:2395:x1876509261438848:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 813us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.943829:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 19 00010000:00010000:0.0:1789579167.943908:0:17120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.943917:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579167.943988:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789579167.943993:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579167.944017:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.944080:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2f200/0xd90373d592f225d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec43f expref: 39 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.944101:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec43f expref: 38 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.944109:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579167.944112:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579167.944115:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939302b2e200, rc 0) 00000100:00100000:0.0:1789579167.944147:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15670:x1876509261438720:12345-192.168.203.37@tcp:101:bash.0 Request processed in 27133us (27415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.944154:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 53 00000100:00100000:2.0:1789579167.951611:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579167.951832:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439104 00000100:00100000:1.0:1789579167.951846:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439104 00000100:00100000:1.0:1789579167.951933:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789579167.951947:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15670:x1876509261439104:12345-192.168.203.37@tcp:103:bash.0 00010000:00010000:1.0:1789579167.951969:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789579167.952002:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7ba00/0xd90373d592f225cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec438 expref: 38 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579167.952048:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2e200/0xd90373d592f225d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec43f expref: 37 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579167.952066:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:1.0:1789579167.952073:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579167.952157:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:15670:x1876509261439104:12345-192.168.203.37@tcp:103:bash.0 Request processed in 213us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579167.952164:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 3 00000100:00100000:1.0:1789579167.957280:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579167.957418:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439232 00000100:00100000:0.0:1789579167.957432:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439232 00000100:00100000:0.0:1789579167.957509:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:0.0:1789579167.957522:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:15670:x1876509261439232:12345-192.168.203.37@tcp:58:bash.0 00010000:00010000:0.0:1789579167.957686:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.957710:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579167.957724:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579167.961342:0:18390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789579167.963840:0:18390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789579167.964336:0:18390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789579167.964573:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:15670:x1876509261439232:12345-192.168.203.37@tcp:58:bash.0 Request processed in 7046us (7300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579167.964596:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 54 00000100:00100000:0.0:1789579167.973521:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579167.975526:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439360 00000100:00100000:2.0:1789579167.975549:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439360 00000100:00100000:2.0:1789579167.975722:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 55 00000100:00100000:2.0:1789579167.975736:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+36:15670:x1876509261439360:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:2.0:1789579167.975764:0:17119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579167.975803:0:17119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec446 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975878:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975891:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 37 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975916:0:17119:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975930:0:17119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 37 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975945:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579167.975949:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579167.975953:0:17119:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 37 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579167.975985:0:17119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363afa00, rc 0) 00000100:00100000:2.0:1789579167.976086:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15670:x1876509261439360:12345-192.168.203.37@tcp:101:bash.0 Request processed in 352us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579167.976093:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 55 00000040:00080000:0.0:1789579168.035754:0:17152:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789579168.035767:0:17152:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579168.035798:0:17152:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789579168.035811:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789579168.036013:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17152:1876509277238272:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789579168.036570:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579168.041478:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.042258:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17152:1876509277238272:192.168.203.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789579168.047625:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439488 00000100:00100000:1.0:1789579168.047647:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439488 00000100:00100000:1.0:1789579168.047745:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:1.0:1789579168.047758:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15671:x1876509261439488:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789579168.047800:0:17118:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789579168.048009:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15671:x1876509261439488:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 252us (6556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.048027:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 56 00000100:00100000:2.0:1789579168.051418:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.051532:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439616 00000100:00100000:0.0:1789579168.051545:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439616 00000100:00100000:0.0:1789579168.051617:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:0.0:1789579168.051630:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15671:x1876509261439616:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.051737:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051759:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051773:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051789:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051796:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051823:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051854:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051864:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051872:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579168.051937:0:17120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789579168.051942:0:17120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579168.051962:0:17120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051975:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051981:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051989:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.051994:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579168.052000:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052007:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052040:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9394039cee00) 00010000:00010000:0.0:1789579168.052043:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579168.052050:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052056:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f225ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052073:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052079:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052085:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052090:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7a800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579168.052093:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052099:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052106:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff939302356c00) 00010000:00010000:0.0:1789579168.052108:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579168.052111:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052117:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f225f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052142:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052149:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052155:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052160:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7bc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579168.052162:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052168:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052176:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579168.052179:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789579168.052182:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.052188:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f225fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.052291:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15671:x1876509261439616:12345-192.168.203.37@tcp:34:lhsmtool_posix.0 Request processed in 663us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.052300:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 57 00000100:00100000:2.0:1789579168.060405:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.062839:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261439872 00000100:00100000:1.0:1789579168.062863:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261439872 00000100:00100000:1.0:1789579168.062968:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789579168.062981:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+37:15671:x1876509261439872:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579168.063010:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579168.063039:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f22603 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec44d expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063181:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063199:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063213:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789579168.063228:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789579168.063331:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063340:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063347:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063396:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579168.063401:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063430:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063445:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:1.0:1789579168.063448:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789579168.063455:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063461:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2260a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063522:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f22603 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec44d expref: 39 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063535:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9394039cee00) 00010000:00010000:1.0:1789579168.063537:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789579168.063541:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519800/0xd90373d592f22603 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec44d expref: 39 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.063552:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401519800, rc 0) 00000100:00100000:1.0:1789579168.063649:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15671:x1876509261439872:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 670us (3305us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1789579168.063657:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 58 00000100:00100000:1.0:1789579168.066425:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.066519:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261440000 00000100:00100000:0.0:1789579168.066532:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261440000 00000100:00100000:0.0:1789579168.066615:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:0.0:1789579168.066645:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15671:x1876509261440000:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789579168.066702:0:17120:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789579168.066860:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15671:x1876509261440000:12345-192.168.203.37@tcp:53:lhsmtool_posix.0 Request processed in 217us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.066868:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 59 00000100:00100000:2.0:1789579168.078977:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.079429:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261440256 00000100:00100000:0.0:1789579168.079443:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261440256 00000100:00100000:0.0:1789579168.079531:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:0.0:1789579168.079543:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+38:15671:x1876509261440256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.079572:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.080317:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22618 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec454 expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789579168.081836:0:18390:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1789579168.081850:0:18390:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789579168.081880:0:18390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789579168.082098:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f2261f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.082118:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f2261f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.082132:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f2261f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.082209:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22618 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec454 expref: 41 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.082260:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f2261f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec454 expref: 40 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.082269:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939302356c00) 00010000:00010000:0.0:1789579168.082273:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789579168.082277:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7a800, rc 0) 00000100:00100000:0.0:1789579168.082455:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+40:15671:x1876509261440256:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 2912us (3492us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789579168.082466:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 60 00000100:00100000:1.0:1789579168.090172:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579168.091693:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261440512 00000100:00100000:2.0:1789579168.091715:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261440512 00000100:00100000:2.0:1789579168.091815:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789579168.091828:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+40:15671:x1876509261440512:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789579168.091910:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579168.091945:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a800/0xd90373d592f2261f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec454 expref: 40 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.091970:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939302356c00) 00010000:00010000:2.0:1789579168.091984:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789579168.092013:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092525:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092539:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092561:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092586:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092592:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092648:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092655:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092662:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092681:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363afe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.092685:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092694:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092703:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579168.092730:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.092735:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092741:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afe00/0xd90373d592f2262d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092755:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092766:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092773:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092778:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.092781:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092788:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092796:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xea9ce6b (ffff93942ef59b00) 00010000:00010000:2.0:1789579168.092799:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.092801:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.092807:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af600/0xd90373d592f22634 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea9ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.092933:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+39:15671:x1876509261440512:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 1105us (2773us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789579168.092943:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 61 00000100:00100000:2.0:1789579168.098463:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.099846:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261440640 00000100:00100000:1.0:1789579168.099866:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261440640 00000100:00100000:1.0:1789579168.099962:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:1.0:1789579168.099996:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+39:15671:x1876509261440640:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579168.100026:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579168.100057:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2263b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec45b expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100118:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22642 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100142:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100157:0:17118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22642 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100328:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f2263b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec45b expref: 41 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100404:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518e00/0xd90373d592f22642 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec45b expref: 40 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.100415:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:1.0:1789579168.100418:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789579168.100422:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518e00, rc 0) 00000100:00100000:1.0:1789579168.100520:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+40:15671:x1876509261440640:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 527us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.100529:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 62 00000100:00100000:1.0:1789579168.106015:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.106119:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261440896 00000100:00100000:0.0:1789579168.106133:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261440896 00000100:00100000:0.0:1789579168.106219:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:0.0:1789579168.106231:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+40:15671:x1876509261440896:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.106391:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.106414:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.106430:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789579168.106679:0:17119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789579168.106690:0:17119:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 523239338928ns, next at 524239335993ns, rc = 0 00000004:00010000:0.0:1789579168.106748:0:17119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a7aeb02 reply state 0000000012c86b04 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.106788:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.106796:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:0.0:1789579168.106800:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789579168.106805:0:17119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789579168.106938:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+42:15671:x1876509261440896:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 708us (935us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789579168.106947:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 63 00000100:00100000:2.0:1789579168.116807:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.116949:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441024 00000100:00100000:1.0:1789579168.116980:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441024 00000100:00100000:1.0:1789579168.117177:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:1.0:1789579168.117473:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+42:15671:x1876509261441024:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789579168.120414:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789579168.120458:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec462 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.120648:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 43 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.120666:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 43 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.120822:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:1.0:1789579168.120826:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789579168.120831:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939401518400, rc 0) 00000100:00100000:1.0:1789579168.120994:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+43:15671:x1876509261441024:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 3805us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.121004:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 64 00000100:00100000:1.0:1789579168.126041:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.126232:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441152 00000100:00100000:3.0:1789579168.126245:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441152 00000100:00100000:3.0:1789579168.126329:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:3.0:1789579168.126342:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+5:2395:x1876509261441152:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789579168.127070:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93930439a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261441152:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 724us (1038us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789579168.127081:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:2.0:1789579168.135542:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.135708:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441408 00000100:00100000:1.0:1789579168.135722:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441408 00000100:00100000:1.0:1789579168.135815:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:1.0:1789579168.135827:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+43:15671:x1876509261441408:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789579168.136637:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+44:15671:x1876509261441408:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 807us (1102us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789579168.136648:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 11 00000100:00100000:2.0:1789579168.140565:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.140750:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441664 00000100:00100000:0.0:1789579168.140764:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441664 00000100:00100000:0.0:1789579168.140996:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:0.0:1789579168.141009:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+44:15671:x1876509261441664:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789579168.141503:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+44:15671:x1876509261441664:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 485us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.141513:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 65 00000100:00100000:2.0:1789579168.146618:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.146831:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441792 00000100:00100000:0.0:1789579168.146845:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441792 00000100:00100000:0.0:1789579168.146920:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:0.0:1789579168.146932:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+44:15671:x1876509261441792:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.146957:0:18390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.146983:0:18390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f22657 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec469 expref: -99 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147339:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147406:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147419:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579168.147479:0:18390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789579168.147512:0:18390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147544:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f22657 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec469 expref: 46 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147568:0:18390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec469 expref: 45 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.147579:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:0.0:1789579168.147582:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789579168.147586:0:18390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7b400, rc 0) 00000100:00100000:0.0:1789579168.147716:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+45:15671:x1876509261441792:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 785us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.147724:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 66 00000100:00100000:1.0:1789579168.161583:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579168.161764:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261441920 00000100:00100000:2.0:1789579168.161778:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261441920 00000100:00100000:2.0:1789579168.161859:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789579168.161871:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+6:2395:x1876509261441920:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789579168.161896:0:18622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789579168.161925:0:18622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec470 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789579168.161960:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaacf9f, blocks: 0x0 00010000:00010000:2.0:1789579168.161986:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789579168.161991:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579168.162003:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.162033:0:18622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.162050:0:18622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9394363af400, rc 0) 00000100:00100000:2.0:1789579168.162125:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2395:x1876509261441920:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 256us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579168.162132:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:2.0:1789579168.178643:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.178857:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442176 00000100:00100000:0.0:1789579168.178871:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442176 00000100:00100000:0.0:1789579168.178961:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:0.0:1789579168.178973:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+45:15671:x1876509261442176:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789579168.179137:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+45:15671:x1876509261442176:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 166us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.179167:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 67 00000100:00100000:1.0:1789579168.184632:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.184962:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442304 00000100:00100000:0.0:1789579168.184974:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442304 00000100:00100000:0.0:1789579168.185053:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 68 00000100:00100000:0.0:1789579168.185065:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+45:15671:x1876509261442304:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789579168.196280:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1789579168.196296:0:17098:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789579168.196580:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789579168.196599:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277238400:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789579168.196618:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196639:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196663:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.196675:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789579168.196684:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303437c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.196692:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196703:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196729:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939302356a00) 00010000:00010000:2.0:1789579168.196733:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.196740:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196748:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303437c00/0xd90373d592f22427 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196780:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196787:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196805:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196811:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939303436800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.196814:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196833:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196842:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:2.0:1789579168.196845:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.196848:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196854:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939303436800/0xd90373d592f2242e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196874:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196881:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789579168.196882:0:17098:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789579168.196893:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196900:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fe00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.196904:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196911:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196923:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9394039ced00) 00010000:00010000:2.0:1789579168.196927:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.196931:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196945:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f224d6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.196949:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277238400 00000100:00100000:3.0:1789579168.196960:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277238400 00010000:00010000:2.0:1789579168.196975:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196984:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196992:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.196998:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030e00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.197002:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197010:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.197029:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789579168.197042:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277238400:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789579168.197153:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789579168.197161:0:18624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789579168.197166:0:18624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789579168.197169:0:18624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789579168.197171:0:18624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789579167 -> 1789579167 00002000:00010000:3.0:1789579168.197174:0:18624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1789579168.197201:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.197206:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.197212:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197219:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030e00/0xd90373d592f2255b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.197242:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1876509277238400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (571us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789579168.197254:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:1.0:1789579168.197313:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939303a48e00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789579168.197324:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277238400:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789579168.197579:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197591:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197598:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197604:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939400030200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:0.0:1789579168.197610:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197618:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197622:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197633:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197635:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:0.0:1789579168.197641:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789579168.197646:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197673:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197687:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af800 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.197693:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.197698:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400030200/0xd90373d592f2247b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197705:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197721:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.197724:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.197728:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197735:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af800/0xd90373d592f2257e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197752:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197759:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197766:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197773:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7aa00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.197777:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197797:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197810:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.197813:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.197816:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197822:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7aa00/0xd90373d592f225c4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.197832:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:15671:x1876509261442304:12345-192.168.203.37@tcp:44:lhsmtool_posix.0 Request processed in 12764us (13208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.197842:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 68 00010000:00010000:2.0:1789579168.197845:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197855:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197861:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197867:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7bc00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.197870:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197876:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197885:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:2.0:1789579168.197888:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789579168.197891:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.197908:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7bc00/0xd90373d592f22649 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.207332:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.209211:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442432 00000100:00100000:1.0:1789579168.209231:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442432 00000100:00100000:1.0:1789579168.209317:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:1.0:1789579168.209329:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2394:x1876509261442432:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789579168.209520:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2394:x1876509261442432:12345-192.168.203.37@tcp:16:lhsmtool_posix.0 Request processed in 193us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.209529:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 24 00000100:00100000:3.0:1789579168.220185:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.221249:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442688 00000100:00100000:0.0:1789579168.221270:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442688 00000100:00100000:0.0:1789579168.221423:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:0.0:1789579168.221437:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+14:15671:x1876509261442688:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.221532:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579168.221569:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b400/0xd90373d592f2265e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec469 expref: 14 pid: 18390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.221599:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:0.0:1789579168.221605:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789579168.221646:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.221663:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.221673:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789579168.221844:0:17120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd3e5a1b reply state 0000000037871c62 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.221883:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a600/0xd90373d592f2266c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.221890:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:0.0:1789579168.221893:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789579168.221897:0:17120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789579168.222038:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+15:15671:x1876509261442688:12345-192.168.203.37@tcp:36:lhsmtool_posix.0 Request processed in 604us (1863us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789579168.222046:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 69 00000100:00100000:3.0:1789579168.234588:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.239543:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442816 00000100:00100000:0.0:1789579168.239567:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442816 00000100:00100000:0.0:1789579168.239953:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:0.0:1789579168.239965:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15671:x1876509261442816:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789579168.239982:0:19481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.240000:0:19481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec477 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.240045:0:19481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.240056:0:19481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579168.240060:0:19481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579168.240065:0:19481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.240095:0:19481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.240121:0:19481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 8 pid: 18622 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.240134:0:19481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19481:1876509277238528:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579168.240222:0:19481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789579168.257118:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.257153:0:19481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19481:1876509277238528:192.168.203.37@tcp:104: 00010000:00010000:0.0:1789579168.257201:0:19481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.257224:0:19481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7b400, rc 0) 00000100:00100000:2.0:1789579168.257417:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261442944 00000100:00100000:2.0:1789579168.257424:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261442944 00010000:00010000:2.0:1789579168.257458:0:17103:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 9 pid: 18622 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.257506:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789579168.257516:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261442944:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789579168.257530:0:17103:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789579168.257549:0:17103:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 9 pid: 18622 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.257561:0:17103:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 9 pid: 18622 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.257583:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a044a7af/0xd90373d592f22665 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec470 expref: 9 pid: 18622 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.257597:0:17103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579168.257600:0:17103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579168.257607:0:17103:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.257634:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.257680:0:17103:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.257693:0:17103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17103:1876509277238656:192.168.203.37@tcp:105: 00000100:00100000:0.0:1789579168.257996:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+8:15671:x1876509261442816:12345-192.168.203.37@tcp:101:lhsmtool_posix.0 Request processed in 18031us (23416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.258005:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 25 00000100:00100000:2.0:1789579168.265178:0:17103:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941ab3a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789579168.275986:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.278230:0:19143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443072 00000100:00100000:3.0:1789579168.278246:0:19143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443072 00000100:00100000:3.0:1789579168.278329:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789579168.278340:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+8:2394:x1876509261443072:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789579168.278541:0:19143:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789579168.278544:0:19143:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789579167 00002000:00010000:3.0:1789579168.278547:0:19143:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789579164 00002000:00010000:3.0:1789579168.278549:0:19143:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789579167 -> 1789579167 00002000:00010000:3.0:1789579168.278551:0:19143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789579168.278623:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261443072:12345-192.168.203.37@tcp:2:lhsmtool_posix.0 Request processed in 284us (2646us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789579168.278630:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 26 00000100:00100000:3.0:1789579168.283633:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579168.284408:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443200 00000100:00100000:2.0:1789579168.284424:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443200 00000100:00100000:2.0:1789579168.284503:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789579168.284514:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261443200:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789579168.284558:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.284579:0:18622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.284588:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789579168.284593:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789579168.284597:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.284650:0:18622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.284675:0:18622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.284690:0:18622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18622:1876509277238784:192.168.203.37@tcp:104: 00000100:00100000:2.0:1789579168.284779:0:18622:0:(client.c:2716:ptlrpc_set_wait()) set ffff939408a976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789579168.285634:0:17103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17103:1876509277238656:192.168.203.37@tcp:105: 00010000:00010000:0.0:1789579168.285656:0:17103:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789579168.285964:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261442944:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 28447us (28859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.285975:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 20 00000100:00100000:2.0:1789579168.292077:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.294809:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443328 00000100:00100000:0.0:1789579168.294824:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443328 00010000:00010000:0.0:1789579168.294871:0:17105:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.294920:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 21 00000100:00100000:0.0:1789579168.294931:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261443328:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789579168.294949:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789579168.294987:0:17105:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.295006:0:17105:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 9 pid: 19481 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.295030:0:17105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579168.295035:0:17105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789579168.295041:0:17105:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.295051:0:17105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.295072:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789579168.295133:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+9:2394:x1876509261443328:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 204us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.295141:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 21 00010000:00010000:1.0:1789579168.300762:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bbab9a/0xd90373d592f22673 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec477 expref: 8 pid: 19481 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579168.300788:0:18622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18622:1876509277238784:192.168.203.37@tcp:104: 00010000:00010000:1.0:1789579168.300814:0:18622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300826:0:18622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300855:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300884:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300893:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300902:0:18622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300909:0:18622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363ae000 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:1.0:1789579168.300913:0:18622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300921:0:18622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300940:0:18622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.300948:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e778aca/0xd90373d592f2267a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579168.301110:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:2394:x1876509261443200:12345-192.168.203.37@tcp:1:lhsmtool_posix.0 Request processed in 16597us (17493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.301120:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 27 00000100:00100000:2.0:1789579168.307392:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.307472:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443584 00000100:00100000:1.0:1789579168.307497:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443584 00000100:00100000:1.0:1789579168.307584:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 70 00000100:00100000:1.0:1789579168.307596:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+15:15671:x1876509261443584:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789579168.307689:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.307707:0:18390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 15 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.307718:0:18390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.307753:0:18390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 15 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.307767:0:18390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 15 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579168.307781:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277238912:192.168.203.37@tcp:104: 00000100:00100000:1.0:1789579168.307868:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff939405e4cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789579168.316464:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.316613:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443712 00000100:00100000:3.0:1789579168.316630:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443712 00010000:00010000:3.0:1789579168.316691:0:17104:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.316758:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 22 00000100:00100000:3.0:1789579168.316773:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:2395:x1876509261443712:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579168.316792:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579168.316800:0:17104:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579168.316824:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939437389f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277238912:192.168.203.37@tcp:104: 00010000:00010000:3.0:1789579168.316853:0:17104:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.316962:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939400031400/0xd90373d592f22554 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec415 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.321932:0:18390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.321994:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:3.0:1789579168.322129:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 15 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.322147:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.322157:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.322166:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.322591:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789579168.322691:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+15:2395:x1876509261443712:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 5920us (6233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579168.322703:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 22 00010000:00010000:1.0:1789579168.323803:0:18390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.323818:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.324896:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.324924:0:18390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 15 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.324935:0:18390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.324983:0:18390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 15 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.325010:0:18390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 15 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789579168.325145:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277239040:192.168.203.37@tcp:104: 00000100:00100000:0.0:1789579168.325627:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff93941ab3a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789579168.329479:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.330053:0:20146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443840 00000100:00100000:3.0:1789579168.330066:0:20146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443840 00010000:00010000:3.0:1789579168.330119:0:20146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789579168.330166:0:20146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 23 00000100:00100000:3.0:1789579168.330178:0:20146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939441a82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:2394:x1876509261443840:12345-192.168.203.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789579168.330196:0:20146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789579168.330217:0:20146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.330233:0:20146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 16 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.330261:0:20146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:3.0:1789579168.330269:0:20146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.330280:0:20146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.330288:0:20146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.330310:0:20146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789579168.330409:0:20146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939441a82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+16:2394:x1876509261443840:12345-192.168.203.37@tcp:103:ldlm_bl.0 Request processed in 232us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579168.330417:0:20146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 23 00010000:00010000:2.0:1789579168.336729:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f22650 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec462 expref: 15 pid: 17118 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.336765:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a49500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277239040:192.168.203.37@tcp:104: 00010000:00010000:2.0:1789579168.336799:0:18390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.336812:0:18390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.336848:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789579168.337013:0:18390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1789579168.338828:0:18390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1789579168.338873:0:18390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1789579168.338999:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18390:1876509277239168:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789579168.339784:0:18390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579168.339893:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff939406670600 going to sleep for 11 seconds 00000100:00100000:3.0:1789579168.339959:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239168 00000100:00100000:3.0:1789579168.339970:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239168 00000100:00100000:3.0:1789579168.340212:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789579168.340226:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18390:x1876509277239168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789579168.340386:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18390:x1876509277239168:12345-0@lo:1000:mdt00_003.0 Request processed in 162us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579168.340394:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789579168.340530:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18390:1876509277239168:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789579168.340773:0:18390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1789579168.340858:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18390:1876509277239296:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789579168.340894:0:18390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579168.341926:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789579168.341999:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239296 00000100:00100000:1.0:1789579168.342009:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239296 00000100:00100000:1.0:1789579168.342168:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789579168.342179:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18390:x1876509277239296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789579168.346572:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18390:x1876509277239296:12345-0@lo:1000:mdt00_003.0 Request processed in 3833us (5115us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789579168.346591:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789579168.347419:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18390:1876509277239296:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789579168.347658:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347672:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347680:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347687:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7be00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.347692:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347725:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347745:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:2.0:1789579168.347748:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579168.347754:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347760:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7be00/0xd90373d592f22688 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347804:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347810:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347815:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347819:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939435d7b600 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.347822:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347828:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347836:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.347839:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789579168.347848:0:18390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 18 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347874:0:18390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 18 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347886:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 18 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.347962:0:18390:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9394363afa00/0xd90373d592f225e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec446 expref: 18 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.347978:0:18390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277239424:192.168.203.37@tcp:105: 00000100:00100000:2.0:1789579168.348296:0:18390:0:(client.c:2716:ptlrpc_set_wait()) set ffff9394091b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1789579168.354105:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:2.0:1789579168.354555:0:18390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18390:1876509277239424:192.168.203.37@tcp:105: 00010000:00010000:2.0:1789579168.354595:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354609:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b600/0xd90373d592f225e0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354651:0:18390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354669:0:18390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354683:0:18390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354696:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354722:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354731:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354737:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9394363af400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.354742:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354749:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354764:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.354767:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789579168.354771:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354777:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9394363af400/0xd90373d592f2268f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354787:0:18390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354793:0:18390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354799:0:18390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354802:0:18390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518200 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:2.0:1789579168.354811:0:18390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354817:0:18390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354825:0:18390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:2.0:1789579168.354828:0:18390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789579168.354830:0:18390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789579168.354835:0:18390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518200/0xd90373d592f22681 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789579168.355085:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15671:x1876509261443584:12345-192.168.203.37@tcp:57:lhsmtool_posix.0 Request processed in 47488us (47730us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789579168.355098:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 70 00000020:00080000:2.0:1789579168.355106:0:18390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789579168.355963:0:17152:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789579168.355972:0:17152:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789579168.356032:0:17152:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789579168.356041:0:17152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789579168.356801:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261443968 00000100:00100000:3.0:1789579168.356815:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261443968 00000100:00100000:3.0:1789579168.360991:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:3.0:1789579168.361428:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15670:x1876509261443968:12345-192.168.203.37@tcp:49:bash.0 00000100:00100000:3.0:1789579168.361627:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15670:x1876509261443968:12345-192.168.203.37@tcp:49:bash.0 Request processed in 619us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579168.361636:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 12 00000100:00100000:1.0:1789579168.367605:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.367925:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:3.0:1789579168.368627:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261444224 00000100:00100000:3.0:1789579168.368643:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261444224 00000100:00100000:3.0:1789579168.368718:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 13 00000100:00100000:3.0:1789579168.368731:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+18:15671:x1876509261444224:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789579168.369159:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261444352 00000100:00100000:0.0:1789579168.369165:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261444352 00000100:00100000:0.0:1789579168.369284:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:0.0:1789579168.369293:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+7:15670:x1876509261444352:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579168.369407:0:19481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.369436:0:19481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165ad199/0xd90373d592f22696 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec47e expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789579168.369772:0:17121:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789579168.369814:0:17121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1789579168.369861:0:17121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369880:0:17121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369895:0:17121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369904:0:17121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369911:0:17121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369917:0:17121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.369938:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789579168.370100:0:19481:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aaacf9f, atime: 0x6aaacf9c, ctime: 0x6aaacf9f, blocks: 0x0 00010000:00010000:0.0:1789579168.370126:0:19481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1789579168.370132:0:19481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789579168.370144:0:19481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165ad199/0xd90373d592f22696 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec47e expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.370176:0:19481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000165ad199/0xd90373d592f22696 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec47e expref: 8 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.370706:0:19481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7ae00, rc 0) 00000100:00100000:0.0:1789579168.370794:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb59b6f8-2a36-456b-b988-f5328ecc7957+8:15670:x1876509261444352:12345-192.168.203.37@tcp:101:bash.0 Request processed in 1500us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.370803:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 28 00000100:00100000:3.0:1789579168.373908:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:15671:x1876509261444224:12345-192.168.203.37@tcp:35:lhsmtool_posix.0 Request processed in 5162us (6301us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1789579168.373929:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 13 00000020:00080000:3.0:1789579168.373939:0:17121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789579168.373983:0:17107:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789579168.373992:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.374003:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939302b2fe00 already unused, calling callback (ffffffffc0c5b8b0) 00010000:00010000:3.0:1789579168.374008:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.374033:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.374053:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93940905b700) 00010000:00010000:3.0:1789579168.374056:0:17107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789579168.374062:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.374069:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939302b2fe00/0xd90373d592f2269d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789579168.374089:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579168.374091:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789579168.374093:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789579168.376234:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.377099:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261444480 00000100:00100000:0.0:1789579168.377117:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261444480 00000100:00100000:0.0:1789579168.377206:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:0.0:1789579168.377219:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+20:15670:x1876509261444480:12345-192.168.203.37@tcp:101:bash.0 00010000:00010000:0.0:1789579168.377247:0:17120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.377275:0:17120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a200/0xd90373d592f226a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec485 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377722:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b200/0xd90373d592f226ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377742:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b200/0xd90373d592f226ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377758:0:17120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b200/0xd90373d592f226ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377906:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a200/0xd90373d592f226a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec485 expref: 22 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377941:0:17120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7b200/0xd90373d592f226ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec485 expref: 21 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.377952:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:0.0:1789579168.377956:0:17120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789579168.377960:0:17120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7b200, rc 0) 00000100:00100000:0.0:1789579168.378083:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:15670:x1876509261444480:12345-192.168.203.37@tcp:101:bash.0 Request processed in 866us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.378092:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 71 00000100:00100000:0.0:1789579168.388151:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.388347:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261444736 00000100:00100000:1.0:1789579168.388406:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261444736 00000100:00100000:1.0:1789579168.388637:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 14 00000100:00100000:1.0:1789579168.388651:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+21:15670:x1876509261444736:12345-192.168.203.37@tcp:35:bash.0 00000001:00080000:1.0:1789579168.389007:0:17122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1789579168.389150:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:15670:x1876509261444736:12345-192.168.203.37@tcp:35:bash.0 Request processed in 500us (1016us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1789579168.389159:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 14 00000020:00080000:1.0:1789579168.389166:0:17122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789579168.537258:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:0.0:1789579168.539300:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261444992 00000100:00100000:0.0:1789579168.539315:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261444992 00000100:00100000:0.0:1789579168.539433:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:0.0:1789579168.539445:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+23:15681:x1876509261444992:12345-192.168.203.37@tcp:101:lfs.0 00010000:00010000:0.0:1789579168.539470:0:17118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789579168.539501:0:17118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a200/0xd90373d592f226b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1cdb1b13840ec48c expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789579168.539608:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789579168.539707:0:17118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a200/0xd90373d592f226b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec48c expref: 25 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.539721:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93940905bb00) 00010000:00010000:0.0:1789579168.539724:0:17118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789579168.539730:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939435d7a200/0xd90373d592f226b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.37@tcp remote: 0x1cdb1b13840ec48c expref: 25 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789579168.539765:0:17118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939435d7a200, rc 0) 00000100:00100000:0.0:1789579168.539834:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939403cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:15681:x1876509261444992:12345-192.168.203.37@tcp:101:lfs.0 Request processed in 391us (2593us total) trans 8589934633 rc 301/301 00000100:00100000:0.0:1789579168.539841:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 72 00000100:00100000:3.0:1789579168.551323:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.555482:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445120 00000100:00100000:1.0:1789579168.555530:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445120 00000100:00100000:1.0:1789579168.555612:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:1.0:1789579168.555625:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:15681:x1876509261445120:12345-192.168.203.37@tcp:34:lfs.0 00010000:00010000:1.0:1789579168.555742:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555763:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555777:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555796:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555803:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555810:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555919:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555930:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.555940:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789579168.556000:0:17119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556513:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556524:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556532:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556539:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401519c00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579168.556545:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556553:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556568:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939302356200) 00010000:00010000:1.0:1789579168.556571:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579168.556577:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556583:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401519c00/0xd90373d592f226c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556598:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556604:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556609:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556622:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518400 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579168.556625:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556630:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556637:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93940905b900) 00010000:00010000:1.0:1789579168.556640:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579168.556642:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556648:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518400/0xd90373d592f226c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556665:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556672:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556678:0:17119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556683:0:17119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939401518a00 already unused, calling callback (ffffffffc186d4f0) 00010000:00010000:1.0:1789579168.556685:0:17119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556690:0:17119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556709:0:17119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9394039ce900) 00010000:00010000:1.0:1789579168.556712:0:17119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789579168.556715:0:17119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789579168.556722:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939401518a00/0xd90373d592f226ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789579168.556842:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:15681:x1876509261445120:12345-192.168.203.37@tcp:34:lfs.0 Request processed in 1205us (5518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579168.556856:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 73 00000100:00100000:3.0:1789579168.560619:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.37@tcp (source: 12345-192.168.203.37@tcp) 00000100:00100000:1.0:1789579168.562101:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509261445376 00000100:00100000:1.0:1789579168.562119:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509261445376 00000100:00100000:1.0:1789579168.562208:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:1.0:1789579168.562221:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+24:15681:x1876509261445376:12345-192.168.203.37@tcp:35:lfs.0 00000100:00100000:1.0:1789579168.562950:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb59b6f8-2a36-456b-b988-f5328ecc7957+25:15681:x1876509261445376:12345-192.168.203.37@tcp:35:lfs.0 Request processed in 728us (2340us total) trans 8589934634 rc 0/0 00000100:00100000:1.0:1789579168.562959:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.37@tcp, seq: 15 00000100:00100000:3.0:1789579168.611799:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277239552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789579168.611913:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579168.612119:0:18222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239552 00000100:00100000:0.0:1789579168.612130:0:18222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239552 00000100:00100000:0.0:1789579168.612198:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789579168.612211:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277239552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789579168.612266:0:18222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789579168.612508:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876509277239552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789579168.612748:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876509277239552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 436us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.612758:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789579168.615524:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789579168.615555:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277239680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789579168.615639:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579168.616459:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239680 00000100:00100000:0.0:1789579168.616491:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239680 00000100:00100000:0.0:1789579168.616562:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789579168.616573:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277239680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789579168.616621:0:17123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789579168.616709:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876509277239680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579168.616717:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789579168.616989:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876509277239680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789579168.677570:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789579169.444470:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789579169.711139:0:17106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789579170.305510:0:20296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1789579170.723769:0:17107:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789579171.171528:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277239936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789579171.171575:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277240192:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.171601:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579171.171632:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579171.171653:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277240320:0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.171682:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277240704:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.171690:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240192 00000100:00100000:0.0:1789579171.171690:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.171700:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240192 00000100:00100000:2.0:1789579171.171720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579171.171734:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277240832:0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.171751:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277241216:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.171757:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789579171.171765:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.171772:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3618:x1876509277240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.171787:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579171.171792:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277241344:0@lo:400:kworker.0 00000100:00100000:1.0:1789579171.171795:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277239808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789579171.171815:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277241728:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.171830:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579171.171831:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.171837:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9394091a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:044b3bf9-43fa-4501-b924-7b81ca047525+24:3618:x1876509277240192:12345-0@lo:400:kworker.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579171.171858:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277240448:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.171862:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789579171.171865:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789579171.171868:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239936 00000100:00100000:0.0:1789579171.171873:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239936 00000100:00100000:1.0:1789579171.171898:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579171.171908:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:044b3bf9-43fa-4501-b924-7b81ca047525:3618:1876509277240192:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.171917:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277239808 00000100:00100000:0.0:1789579171.171921:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277239808 00000100:00100000:3.0:1789579171.171927:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240704 00000100:00100000:1.0:1789579171.171930:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277240960:0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.171933:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789579171.171934:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240704 00000100:00100000:0.0:1789579171.171944:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789579171.171946:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939403cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277240064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789579171.171956:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277239936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789579171.171959:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.171981:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241216 00000100:00100000:2.0:1789579171.171982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789579171.171983:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277241472:0@lo:400:kworker.0 00002000:00000024:0.0:1789579171.171983:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789579171.171987:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241216 00000100:00100000:2.0:1789579171.172006:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93943f6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277240576:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.172007:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241344 00000100:00100000:3.0:1789579171.172012:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241344 00000100:00100000:3.0:1789579171.172034:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241728 00000100:00100000:2.0:1789579171.172037:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.172039:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241728 00000100:00100000:3.0:1789579171.172060:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789579171.172063:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277241088:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.172071:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.172092:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789579171.172114:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff939304170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277241600:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.172120:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1876509277240704:12345-0@lo:400:kworker.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.172128:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789579171.172143:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.172146:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789579171.172170:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277241216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.172173:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876509277240704:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.172184:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1876509277239936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 229us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579171.172193:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579171.172212:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240064 00000100:00100000:0.0:1789579171.172216:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240064 00000100:00100000:3.0:1789579171.172218:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1876509277241216:12345-0@lo:400:kworker.0 Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.172236:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789579171.172241:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579171.172251:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277239808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579171.172253:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241600 00000100:00100000:3.0:1789579171.172260:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241600 00002000:00000024:0.0:1789579171.172265:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789579171.172285:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789579171.172294:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277241344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.172309:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277239808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579171.172317:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789579171.172336:0:18627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789579171.172340:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876509277241344:12345-0@lo:400:kworker.0 Request processed in 46us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.172376:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789579171.172393:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876509277241216:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.172397:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789579171.172408:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277241728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.172423:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789579171.172430:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277241600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.172460:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1876509277241600:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579171.172465:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789579171.172496:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789579171.172516:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939304197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876509277241728:12345-0@lo:400:kworker.0 Request processed in 44us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.172525:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789579171.172538:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277239808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789579171.172541:0:18390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241472 00000100:00100000:3.0:1789579171.172547:0:18390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241472 00000100:00100000:3.0:1789579171.172573:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789579171.172573:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240320 00000100:00100000:1.0:1789579171.172579:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240320 00000100:00100000:3.0:1789579171.172584:0:18390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277241472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579171.172612:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240832 00000100:00100000:1.0:1789579171.172616:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240832 00000100:00100000:3.0:1789579171.172629:0:18390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876509277241472:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.172635:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789579171.172649:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789579171.172748:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876509277241600:0@lo:400:kworker.0 00010000:00080000:2.0:1789579171.172761:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304173b80 x1876509277241728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789579171.172771:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876509277241728:0@lo:400:kworker.0 00010000:00080000:2.0:1789579171.172830:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939304172a00 x1876509277241472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789579187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789579171.172837:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277240320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.172847:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876509277241472:0@lo:400:kworker.0 00000100:00100000:1.0:1789579171.172881:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939303a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876509277240320:12345-0@lo:400:kworker.0 Request processed in 49us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579171.172981:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240448 00000100:00100000:2.0:1789579171.173046:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240448 00000100:00100000:3.0:1789579171.173114:0:18222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789579171.173126:0:18222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277240832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.173127:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240960 00000100:00100000:2.0:1789579171.173132:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240960 00000100:00100000:2.0:1789579171.173153:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277240576 00000100:00100000:2.0:1789579171.173155:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277240576 00000100:00100000:2.0:1789579171.173165:0:19481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876509277241088 00000100:00100000:2.0:1789579171.173167:0:19481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876509277241088 00000100:00100000:2.0:1789579171.173178:0:19481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789579171.173184:0:19481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939437389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1876509277240448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579171.173197:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789579171.173227:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789579171.173231:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789579171.173233:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789579171.173236:0:17114:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789579171.173246:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789579171.173254:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277240960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.173337:0:18627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93943f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277240064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789579171.173424:0:18627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789579171.173477:0:18222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876509277240832:12345-0@lo:400:kworker.0 Request processed in 345us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789579171.173486:0:18222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789579171.173497:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876509277240960:12345-0@lo:400:kworker.0 Request processed in 242us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579171.173497:0:18627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93943f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1876509277240064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1152us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579171.173507:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789579171.173514:0:18627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789579171.173525:0:19143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789579171.173532:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789579171.173538:0:19143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277240576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789579171.173544:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277241088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.173549:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277240320:0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.173555:0:19481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939437389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876509277240448:12345-0@lo:400:kworker.0 Request processed in 369us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789579171.173564:0:19481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789579171.173578:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876509277240832:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.173595:0:19143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1876509277240576:12345-0@lo:400:kworker.0 Request processed in 58us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789579171.173595:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff939408eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876509277241088:12345-0@lo:400:kworker.0 Request processed in 53us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789579171.173596:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939304171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876509277241344:0@lo:400:kworker.0 00000100:00100000:2.0:1789579171.173612:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876509277240448:0@lo:400:kworker.0 00000100:00100000:3.0:1789579171.173613:0:19143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789579171.173633:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876509277240960:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.173685:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876509277239936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789579171.173735:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939403cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277240064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789579171.173748:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789579171.173750:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93943f6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876509277240576:0@lo:400:kworker.0 00000100:00100000:0.0:1789579171.173761:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff939303a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876509277241088:0@lo:400:kworker.0 00010000:00010000:1.0:1789579171.747586:0:19485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42641 lines, 42641 kept, 0 dropped, 0 bad.